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Abstract 


The  purpose  of  this  research  was  to  demonstrate  hew 
microcomputer-based  logistics  models  could  be  used  to  en- 
nance  the  analysis  of  major  project  proposals  for  the  t:CAF 
Productivity  .  Re  i  i  ab  1  i  1  ty  .  Ava  1 1  ab  1 1  i  tv  .  and  Ma  i  nt  a :  < . 1:  i  1  :  * 
(PRAM)  Procram  Office.  The  research  used  a  tailored  ic- 


proach .  assuming  that  the  use  :f  more  than 


be  required. 

The  study  starts  by  reviewing  the  importance  of  r  •.  ch:v:- 
logy  insertion  to  the  military,  focusing  on  the  Am  r  . r  • 
process.  The  evolution  of  the  USAh  Productivity.  R-liati 
lit.  y  .  A  v  a  :  1  a  b  i  1  1 1  y  .  a  n  d  M  a  :  n  t  a  i  n  a  b  i  1  1 1  y  !  p  R  A  M  :  Pr.gr  \  :r. 

Office  is  discussed.  Included  is  the  process  that  PRAM  u.v-s 


to  assess  technology  insert  r,-n  .  pose  is 


bulb  of  fl> 


literature  review  discusses  the  evolution  of  comput er  -bis  -  : 
logistics  support  models .  focusing  on  the  capabilities  that 
current  models  offer  the  supr.-  -rtabi  i  ity  analyst  . 

Three  PRAM  projects  were  selected  fir  analyse:-.  The 


or esent  d  " ty r i 


•  •••  ■-  r  > ;  Pid  y  t  %  -  •  y;  v 


PRAM  o  f  f  i  'e  ,  wh  i  ch 


en  previous ly  analysed  by  the  PRAM 


could  be  used  to  perform  cost/benef  1 1  analysis,  a  t  rue  •  u  re¬ 
ap  pr  •-•ash  was  taken  f determine-  tic  dec  is  i  -n  in-oo  s  r  i .  -n  -r 


d  a  t  a  a  vo  1 1  a  b  1  e  :  o  r  e  a  c  h  p  r 


An  initial  mode  1  survey  was  made  t-'  identify  ,v.:d* 
that  might  have  capabilities  matching  the  level  at 


required  for  each  project.  The  survey  identified  the  ne 
for  a  greater  amount  of  data  for  all  projects  before  any 
model  could  be  used.  During  this  additional  data  gathn 
process,  several  data  qual  ity  issues  surfaced,  ind:  cat  li¬ 
the  need  for  models  with  strong  sensitivity  analysis  rap 
abi 1  it ies .  After  all  additional  data  was  collected.  :  : : 
model  selection  was  made,  and  .analyses  were  perform*-  i  us 
two  models.  the  Statistical  iy  Improved  Life  ty : ;  e  '"nr? 
tSILCC)  and  the  Cost  Analysis  and  Strategy  Assessment  ;  ' 
mode i s . 

This  research  demonstrated  that  mere  thorough  aymi, 


a n a  1  y s  l  s  w as  p o s s  l  b 


us  i  no 


ocr  i  st  i  cs  mod  1  s  . 


projects  analysed,  the  findings  revealed  that  the  an. 
PRAM  analysis  had  ovo  rest  imat  ed  the  cost  savmncs  o-r  tl 
proposed  improvement .  Add l t ;ona 1 ly .  the  models  were  • 
p e r  f  o r m  detailed  sei i .r  1 1 1  v i :: y  a n a  1  y s  i  s  .  t h -■» r  e by  m :  1 1  g . v 
the  effects  of  data  unc  art  a  i  nt  y  .  The  thesis  oT.'lud  . 
recommending  f  urther  w'-rk  a  aw  a;  ::  : rov :  a.  :  da-  :  m.: 

•level  if’irg  a  standardised  PRAM  data  col  l‘---t  i  m.  :. :  c 


p  1  ladling  nvade  i  ing  iinpi  ^Ciiriitar  n 


i  n  :  n- 


i  di  i  i  cy  or  i riv.j 


due t i ng  resear, 
modeling  approach  m  at  her  lo-gist  ics  sup.  per 


<  i  .  ,  .  *  i  . 
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USING  MICROCOMPUTER-BASED  LOGISTICS  MODELS  TO  ENHANCE 


SUPPORTABILITY  ASSESSMENT  FOR  THE  USAF 
PRODUCTIVITY,  RELIABILITY , AVAILABILITY  AMD  MAINTAINABILITY 
(PRAM)  PROGRAM  OFFICE:  A  TAILORED  APPROACH 

I .  I ntroduct ion 

General  Issue 

During  the  last  quarter  century,  the  pace  of  techno¬ 
logical  innovation  has  been  staggering.  Large  organizations 
struggle  to  keep  up  with  the  explosion  of  innovative  prod¬ 
ucts  and  services.  In  today's  complex  technological  en¬ 
vironment,  any  organization  that  fails  to  seize  the  oppor¬ 
tunities  that  technology  offers  often  loses  its  strategic 
advantage  over  competing  organizations. 

Technological  innovation  is  an  extremely  important 
issue  for  the  military.  While  technological  innovation  is 
only  one  part  of  the  overall  military  equation,  when  used 
properly  it  is  "a  significant  discriminator  on  the  modern 
battlefield,"  as  well  as  a  force  multiplier  (29:33). 

Failure  of  the  military  to  transfer  technological  innova¬ 
tions  from  ideas,  laboratories,  or  from  the  private  sector 
into  practical  field  applications  may  mean  loss  of  stra¬ 
tegic,  tactical,  and  logistical  advantages. 

Technology  insertion  often  offers  the  chance  to  reduce 
costs,  while  improving  performance,  reliability,  and  main¬ 
tainability  at  the  same  time.  This  is  true  not  only  in  new 


1 


products  and  weapon  systems,  but  f  *-r  exist  mg  products 
weapon  systems  as  well. 

Not  all  promising  technological  innovations  can  t 
cessfui ly  transferred  into  practical  military  appl  icat 
however.  Before  these  innovations  are  adopted,  t hey  m 
meet  military  requirements.  Within  the  Air  Force  t  .  :la 
before  any  proposed  technology  improvement  can  be  : me  1 
men ted .  it  must  be  evaluated  against  Air  Force  su:  ::o: t 
ability  criteria  as  outlined  ir,  the  :'FAF  Rt'.M  h"'~ 

These  criteria  include: 

1  .  Increase  d  c  crab  a  t  c  apabi  1  it.  y  . 

2.  Decreased  vulnerability  of  the  combat  .-support 

structure . 

3.  Decreased  mobility  requirements:  ;  i-r  nr.it. 

4.  Decreased  man  cower  requirements  p~i  unit  :-f  u 


Innovation  decisions  based  on  these  criteria  ar'- 
difficult  to  make.  Much  of  the  data  on  pro  p-eod  ‘e-'hn 
logic  a  1  impro-vements  is  very  "soft"  and  th^i-fore  sub: 
qualitative  analysis  and  subiesf.iv---  ’ud  :d  .  Wh :  1 
factors  make  up  a  very  import  on  t  part  of  any  c  *mp  1  e  t  -• 


tics  analysis,  most  senior  Air  Force  manager 


q  1  J  _  w  .  i  i 


approve  any  monetary  cut  lays  for  technology  miles, 
and  benefits  of  the  investment  can  be  mart i tat i v 


As  much  of  fnis  era  ant  i  t  at :  ve  ana  1  vs  is  is 


rudimentary,  these  managers  usually  welcome  any  efforts  to 
improve  their  quantitative  ability. 

In  the  past,  detailed  quantitative  analysis  of  the 
costs  and  benefits  associated  with  technological  innovations 
proved  to  be  a  demanding  task  due,  in  part,  to  the  lack  of 
portable,  easy-to-use  logistics  support  models  that  could 
help  the  analyst  make  sense  of  the  massive  amount  of  data. 
Many  models  existed  on  larger  mainframe  computers,  and  their 
restricted  access  and  complexity  often  discouraged  many 
support  analysts  from  using  them. 

Today,  however,  advances  in  microcomputer  technology 
have  dramatically  changed  this  process.  Large  increases  in 
microcomputer  memory,  drastic  reductions  in  the  price  of 
microcomputer  hardware,  and  impressive  improvements  in 
microcomputer  software  have  all  contributed  to  the  appear¬ 
ance  of  several  microcomputer-based  logistics  support  models 
that  promise  to  greatly  simplify  the  task  of  supportabi 1 i ty 
assessment  (40:39).  Further  improvements  in  this  area  offer 
the  promise  of  even  more  logistics  models  in  the  very  near 
future . 

While  the  creators  of  these  computerized  logistics  sup¬ 
port  models  extol  their  virtues  and  promise  assistance  in 
supportabi 1 ity  assessment,  their  arrival  has  spawned  quite 
another  dilemma.  With  all  the  logistics  support  models 
available  today,  how  does  an  analyst  know  exactly  which 
models  to  use?  Additionally,  how  can  the  models  practically 
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assist  in  the  quantitative  analysis  of  proposed  techno¬ 
logical  innovations? 

A  new  initiative  sponsored  jointly  by  the  Air  Force 
Logistics  Command  ( AFLC )  and  the  Air  Force  System  Common 
( AFSC )  is  trying  to  help  analysts  find  answers  *•  these 
questions.  This  initiative,  if  successful .  would  result 
a  permanent  Support abi I lty  Investment  Decision  Analysis 
Center  (  SIDAC )  .  The  SI  DAT  is  be  i  r.a  cha  1  leaded  t  r 
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effectiveness  and  support  cost  problems  reported  by  any  Air 
Force  unit  (14:1-1). 

The  RIVET  GYRO  task  force  continued  to  perform  its  mis¬ 
sion  until  1975  when  it  was  directed  to  become  a  permanent 
organization  by  the  Air  Force  Chief  of  Staff  (14:1-1).  It 
continued  on  with  the  same  objectives  of  the  RIVET  GYRO  task 
force,  and  existed  as  a  separate  agency  until  1987,  when  it 
became  part  of  the  Air  Force  Logistics  Command  (AFLC)/Air 
Force  System  Command's  (AFSC)  Joint  Technology  Insertion 
Program  (JTIP) .  The  expanded  mission  of  PRAM  under  JTIP  is 
"to  provide  Air  Force  activities  the  means  to  immediately 
respond  to  new  ideas  to  enhance  combat  effectiveness,  im¬ 
prove  productivity,  and  reduce  operational  and  support 
costs"  ( 14 : 1-1 ) . 

A  major  portion  of  PRAM'S  activities  consists  of  evalu¬ 
ating  these  new  ideas  and  technologies  for  adaptability  to 
existing  Air  Force  weapon  systems.  Projects  proposed  to 
PRAM  can  come  from  almost  anywhere;  from  such  diverse  places 
as  aircraft  and  item  users,  maintainers.  or  defense  con¬ 
tractors  (44)  . 

All  of  the  proposed  projects  are  evaluated  against  Air 
Force  supportabi 1 i ty  criteria,  with  the  focus  on  improve¬ 
ments  over  existing  systems.  This  evaluation  process  is 
currently  being  accomplished  through  a  manual  and  highly 
qualitative  validation  process.  Program  managers  evaluate 
project  proposals  based  on  the  limited  data  presented  in  the 


5 


proposal  itself,  personal  experience  in  the  area,  and  other 
qualitative  methods,  such  as  consulting  with  other  AFLC  and 
AFSC  logistics  and  engineering  personnel  (17).  While  this 
process  has  proved  practical,  PRAM  management  would  like  to 
determine  if  and  how  current  microcomputer-based  logistical 
support  models  can  be  used  to  assist  in  the  evaluation  of 
supportabi 1 lty  assessments  for  major  PRAM  project  proposals. 

Research  Problem 

This  research  was  conducted  to  determine  how  the  use  of 
existing  microcomputer-based  logistics  support  models  could 
improve  the  evaluation  and  validation  of  technology  support  - 
ability  assessment  for  major  PRAM  project  proposals.  Ad  1 :  - 
tionally,  this  study  analyzed  the  benefits  and  the  1 lmi'a 
tions  of  using  a  tailored  modeling  methodology  for  pert  .nr. 
ing  PRAM  project  proposal  evaluation. 

Assumpt ions 

1.  The  state  of  microcomputer-based  logistical  support 
models  has  advanced  to  the  point  where  a  sufficiently  large 
number  of  models  are  available  for  the  Air  Force  to  consider 
this  problem  valid. 

2.  PRAM  project  managers  have  sufficient  knowledge  of 
their  proposed  projects  to  provide  satisfactory  answers 
regarding  the  data  required  for  the  level  of  quantitative 
analysis  undertaken. 
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Investigative  Questions 


To  facilitate  this  research,  each  of  the  following 
questions  was  investigated: 

1.  How  are  proposals  evaluated  under  the  existing 
system? 

a.  What  types  of  decision  orientations  are  typical¬ 
ly  considered  when  performing  PRAM  project  analyses? 

b.  What  type  of  data  collection  procedures  are  used 
in  gathering  data  to  evaluate  proposals? 

2.  What  reliability,  maintainability,  supportabi 1 lty , 
and  life  cycle  cost  variables  are  appropriate  for  each  pro¬ 
posal?  Additionally,  who  determines  the  validity  of  these 
variables? 

3.  Are  there  validated  microcomputer-based  logistics 
models  in  existence  for  evaluating  these  measurements? 

4.  Do  microcomputer-based  logistics  support  models 
exist  which  can  be  adapted  to  specific  PRAM  proposal  evalua¬ 
tions? 

5.  Can  a  tailored  approach  (the  use  of  one  or  more 
models,  or  a  combination  of  models)  be  used  to  assist  in 
PRAM  proposal  validation  across  a  wide  spectrum  of  Air  Force 
equipment  and  weapon  systems? 

6.  What  limitations  exist  in  using  current  micro¬ 
computer-based  logistics  models  in  evaluating  PRAM  project 
proposa Is? 
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7.  Can  the  use  of  current  microcomputer-based, 
quantitative  logistics  models  assist  in  the  cost/benefit 
analysis  of  technology  insertion? 

Scope  and  Limitations 

At  any  given  period  of  time  the  PRAM  Program  office  has 
more  that  100  active  projects  under  consideration.  As  this 
was  exploratory  research,  in  order  to  sufficiently  narrow 
the  scope  of  the  research  effort,  only  three  project  pro¬ 
posals  were  used  for  evaluation.  According  to  PRAM  person¬ 
nel,  these  projects  were  typical  of  the  range  of  proposals 
received  by  the  PRAM  office.  Once  the  level  of  management 
analysis  and  data  requirements  were  determined,  each  PRAM 
proposal  was  quantitatively  analyzed  using  the  model  that 
best  suited  the  analysis.  While  using  more  than  one  model 
for  proposal  analysis  and  then  comparing  results  would 
greatly  improve  the  internal  validity  of  this  research,  it 
was  beyond  the  exploratory  nature  of  this  study. 
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Literature  Review 


II  . 

Overview  and  Scope 

This  review  starts  with  the  general  issue  of  technology 
insertion,  beginning  with  a  broad  overview  of  the  issue,  and 
ends  with  a  discussion  of  specifically  how  the  PRAM  Program 
office  adapts  existing  technologies  to  Air  Force  applica¬ 
tions.  Next,  the  use  of  microcomputer-based  models  as  a 
means  of  quantitatively  evaluating  proposals  for  technology 
insertion  within  the  Air  Force  is  examined,  starting  with  a 
discussion  of  the  expanding  use  of  these  models  and  con¬ 
cluding  with  specific  examples  of  their  use.  The  final 
section  of  this  review  discusses  current  Air  Force  efforts 
to  adopt  a  similar  tailored  methodology  through  the  estab¬ 
lishment  of  the  Support.abi  1 1  ty  Investment  Decision  Analysis 
Center  ( SIDAC )  . 

The  Importance  of  Technological  Innovation 

Few  would  argue  the  importance  of  the  need  for  tech¬ 
nological  innovation  in  today's  environment.  Allesch,  m 
his  article  about  the  innovation  process  and  technology, 
remarked  that  because  of  the  shortening  of  life  cycles  m 
technological  development,  innovation  "has  become  a  decisive 
factor  for  survival"  in  today’s  organizational  world  (1:3). 

Because  technology  innovation  is  so  vital,  Allesch 
argues  that  innovation  must  be  systematically  managed  and 
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supported  by  top  management  within  the  organization. 

A 1 lesch  states : 

The  positive  attitude  of  top  management  and  executives 
towards  innovation,  and  their  support  of  those  staff 
members  directly  involved  in  particular  phases  of  the 
innovation  process  will  decisively  influence  its  suc¬ 
cess  (1:5) . 

A1 lesch  goes  on  to  discuss  h^w  the  innovation  process 
should  function  within  an  organization,  including  five 
specific  phases  for  successfully  managing  innovation:  the 
recognition  of  opportunity;  idea  formulation;  product  defin¬ 
ition;  prototype  solution;  and  finally,  technology  utiliza¬ 
tion  and  diffusion  (1:12).  While  written  for  primarily  a 
civilian  industrial  audience,  this  description  of  the  in¬ 
novation  management  process  has  broad  implications  for 
military  organizations  as  well. 

Muramatsu  and  Ichimura  also  discuss  techno  1 og l ca 1 
innovation,  although  their  discussion  is  more  narrowly 
focused  on  product  innovation  management  (34:15).  However, 
their  article  does  address  important  aspects  involved  in 
managing  product  innovation.  In  their  article,  Muramatsu 
and  Ichimura  underscore  the  importance  of  product  innovation 
management  as  an  important  business  strategy.  Their  sugges¬ 
tion  that  product  innovation  management  is  critical  to  the 
fundamental  survival  of  the  corporation,  also  has  implica¬ 
tions  for  the  military.  While  the  military  has  no  market 
share  to  gain  or  hold,  it  is  very  concerned  with  maintaining 
strategic  advantage. 
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Muramatsu  and  Ichimura  contend  that  any  effective 
evaluation  of  product  improvement  management  includes  the 
use  of  specific  measurements  to  gauge  management  progress. 
Although  two  of  the  measurements,  the  new  product  sales  to 
total  sales  ratio  and  the  profit  gained  by  new  product  to 
total  sales  have  no  military  equivalent,  the  concept  of 
using  return  on  investment  (ROI)  as  a  measure  of  management 
success  is  used  in  Air  Force  product  innovation  management 
(44)  . 

The  authors  note  the  importance  of  developing  informa¬ 
tion  to  help  in  the  analysis  of  new  product  development. 
Product  characterist i cs  that  should  be  evaluated  during 
development  include: 

-  specification 

-  efficiency 

-  reliability 

-  safety 

-  maintainability 

-  ease  of  operation 

-  transportability 

-  feeling 

-  guarantee 

-  life  eye  1 e  costs 

-  others  (34.21)  . 

Muramatsu  and  Ichimura  state  that  information  gathered  in 
each  category  "will  help  top  management  make  decisions 
regarding  new  product  development"  (34:21). 

It  is  important  to  note  that  with  only  a  few  minor 
modifications,  the  entire  list  of  product  characteristics 
applies  to  Air  Force  product  innovation  applications,  as 
well  as  civilian  applications.  When  Air  Force  product 
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innovations  proposals  are  evaluated,  current  Air  Force 
regulations  mandate  that  decision-makers  consider  the  R&.M 
2000  goals  of  combat  capability,  combat  support  vulner¬ 
ability,  manpower,  mobility,  and  costs  when  making  innova¬ 
tion  recommendations  (24:2).  These  R&M  2000  goals  incor¬ 
porate  all  of  the  product  characteristics  that  Muramatsu  and 
Ichimura  discuss  in  their  article  on  product  innovation 
management  although  they  fail  to  mention  any  quantitative  or 
qualitative  measurement  considerations  for  product  charac¬ 
teristics  (34:21)  . 

Technological  Innovation:  Its  Military  Importance 

While  technological  innovation  has  broad  implications 
for  survival  across  the  organizational  spectrum,  nowhere  is 
the  successful  management  of  technological  innovations  more 
keenly  felt  than  in  military  organizations.  Whereas  the 
failure  to  successfully  manage  technological  innovation  in 
the  corporate  world  might  spell  the  demise  of  a  particular 
corporation,  failure  to  successfully  manage  technological 
innovation  in  a  military  organization  can  have  a  potentially 
severe  impact  on  national  security  and  war-making  capabil¬ 
ity. 

Retired  Air  Force  Lieutenant  Colonel  David  Mets  high¬ 
lighted  the  importance  of  technology  on  the  battlefield 
(32:13).  Mets  implied  that  there  have  been  times  throughout 
history  when  technology  was  the  decisive  factor  in  battle. 
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He  also  suggests  that  there  may  have  been  times  when  a  newly 
developed  technology  could  have  been  the  decisive  factor, 
but  military  leaders  were  "simply  not  ready"  to  take  ad¬ 
vantage  of  the  opportunity  posed  by  technology,  many  times 
because  they  did  not  believe  the  technology  would  work 
(32 : 13)  . 

Mets  then  points  out  several  examples  of  where  technol¬ 
ogy  could  have  been  the  deciding  factor,  including  advances 
during  the  civil  war,  the  failure  of  military  leaders  to 
take  advantage  of  the  technological  innovations  of  WW  I,  and 
a  number  of  technological  innovations  in  U.S.  Air  Force  air 
superiority  and  close  air  support  arenas  that  could  prove  to 
be  the  deciding  factor  on  the  battlefield  of  the  future 
(32:16) . 

Unfortunately,  Mets  left  out  any  discussion  about  the 
evaluation  of  techno  1 og l ca 1  innovation.  However,  Major 
Robert  Maginnis,  in  his  article  "Selecting  Emerging  Tech¬ 
nologies,"  gives  us  a  brief  expose  on  areas  to  evaluate  when 
selecting  technologies  for  battlefield  use  (29:33). 

While  Major  Maginms's  discussion  of  evaluation 
criteria  focuses  in  on  emerging  technologies  for  the  Army, 
it  also  applies  to  existing  technologies  and  cuts  across 
service  boundaries  as  well.  Maginnis  suggests  that  in 
testing  each  technology  for  its  military  application,  the 
Army  uses  the  following  five  questions: 
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1.  Does  the  new  technology  allow  the  Army  to  do  more 
with  less? 

2.  Will  it  deliver  more  rounds  on  target,  travel  more 
miles  per  gallon,  provide  more  punch  per  round,  last 
longer  between  overhauls  and  more? 

2.  Does  the  new  technology  reduce  the  current  admini¬ 
strative  and  logistical  requirements  of  the  system  to 
be  replaced? 

4.  Does  the  new  technology  simplify  training? 

5.  Is  the  new  technology  the  best  use  of  scarce  re¬ 
sources?  (29:36-39). 

Maginnis  stresses  the  importance  of  selecting  proper 

technologies  for  military  applications  when  he  declares: 

the  U . S .  and  the  U.S.S.R.  are  locked  in  a  struggle  to 
capitalize  on  military.  technologies.  The  objective  is 
military  superici ity  and  political  leverage.  They  are 
able  adversaries  we  must  counter  (29:41). 

Maginnis  suggests  that  in  order  to  counter  the  Soviet 
technological  threat,  the  Army  must  integrate  technological 
innovations  into  its  weapons  and  equipment.  He  concludes  by 
declaring  that  only  by  evaluating  technological  innovations 
against  the  five  questions  posed  earlier  in  this  article, 
will  the  Army  encounter  a  measured  amount  of  success  with 
technological  innovation  (29:41). 

Maginnis  also  discusses  evaluation  criteria  for  emer¬ 
ging  technologies.  In  this  regard,  he  narrows  the  focus  of 
technological  innovation  even  further  than  Mets,  but  focuses 
only  on  selecting  emerging  technologies  for  the  Army.  The 
methods  which  the  Air  Force  uses  to  evaluate  emerging  and 
existing  technological  innovations  for  Air  Force  applica- 
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tions  differ  somewhat,  according  to  its  unique  national 
security  roles  and  missions.  The  next  section  of  this 
literature  review  focuses  on  one  office  within  the  Aar  Force 
which  finds  itself  intimately  involved  in  the  Air  Force 
technological  innovation  process. 

Th^  U5AF  FRAM  Program  Or f ice 

The  United  States  Air  Force  has  a  number  of  research 
and  development  programs  dedicated  to  technological  innova¬ 
tion.  However,  most  of  them  are  concerned  only  with  devel¬ 
oping  emerging  technologies  for  future  weapon  systems.  For 
many  years  there  was  no  coordinated  effort  to  evaluate 
existing,  "off-the-shelf"  technological  innovations  for 
broad  Air  Force  application.  The  Air  Force  lost  many  oppor¬ 
tunities  to  take  advantage  of  significant  gains  in  technol¬ 
ogy  (44).  That  changed  in  1975.  when  the  Air  Force  Chief  of 
Staff  established  the  Productivity,  Reliability,  Avail¬ 
ability,  and  Maintainability  (PRAM)  Program.  The  PRAM 
Program  was  designated  by  the  Chief  of  Staff  to  "immediately 
respond  to  new  ideas  to  enhance  combat  effectiveness,  im¬ 
prove  productivity,  and  reduce  Air  Force  operations  and 
support  (O&S)  costs"  (15:1). 

The  PRAM  office  accomplishes  its  objectives  through  the 
initial  screening  and  thorough  investigation  of  new  ideas 
submitted  to  it  from  a  wide  variety  of  Air  Force  and  private 
agencies.  All  of  the  ideas  submitted  to  the  PRAM  office  are 
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proposals  to  Incorporate  new  or  existing  technologies  into 
fielded  weapon  systems  or  proposals  to  use  this  technology 
to  improve  an  operational  or  support  process  (17). 

The  PRAM  Program  Management  Directive  directs  the 
program  office  to  identify  projects  with  potential  for 
improvement  in: 

a.  R&M  improvements  which  enhance  warfighting 
capability  and  logistics  performance. 

b.  Systems,  subsystems,  or  equipment  with  consistently 
low  reliability  and  maintainability  and/or  high  O&S 
costs . 

c.  Maintenance,  operating  and  training  concepts. 

d.  Personnel  productivity  including  training  and  skill 
levels . 

e.  Adaptability  of  equipment  to  broader  app 1 icat ions . 

f.  Maintenance  data  collection  systems,  data  informa¬ 
tion  analysis  systems,  and  other  procedural  systems 
(15:4). 

If  it  becomes  readily  apparent  from  initial  screening  that 
the  proposed  idea  will  not  improve  one  of  the  categories 
listed  above,  the  idea  has  a  very  low  probability  of  being 
evaluated  by  the  PRAM  office  (44). 

This  initial  screening  is  also  called  the  PRAM  inves¬ 
tigation.  It  is  designed  to  provide  senior  PRAM  decision 
makers  relevant  answers  to  the  following  questions: 

1.  Is  there  a  real  problem  that  PRAM  can  realistically 
affect? 

2.  How  critical  is  the  problem?  How  does  it  relate  to 
R&M  2000  objectives  and  the  PRAM  charter? 

3.  Is  there  a  likely,  practical  solution?  Are  costs 
and  schedule  to  attain  the  solution  realistic? 
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4.  Are  there  on-going  related  efforts?  How  are  they 
related?  Is  there  a  potential  duplication  of  effort? 

5.  If  approved  as  a  PRAM  project,  who  will  manage  it? 
What  other  organizations  need  to  participate? 

6.  Is  there  support  from  the  operational  command,  the 
SPO  or  the  SPM  to  perform  this  effort  as  a  PRAM 
project? 

7.  Who  will  implement  the  results?  How  will  they  be 
imp  1 emented? 

8.  If  a  cost  saving  errort .  can  the  before"  and 
"after"  costs  be  obtained?  Are  the  net  benefits 
sufficiently  large  to  justify  the  project?  (14:3-1). 

The  initial  PRAM  investigation  reflects  the  highly  qualita¬ 
tive  nature  of  these  questions.  As  a  result,  the  initial  go- 
ahead  decision  relies  heavily  on  the  subjective  judgement  of 
senior  PRAM  management.  The  only  objective  of  the  PRAM 
office  at  this  stage  is  to  determine  whether  or  not  the  idea 
has  sufficient  merit  to  justify  the  expenditure  of  resources 
in  performing  a  full  scale  cost/benefit  evaluation. 

Once  an  idea  has  successfully  survived  this  initial 
screening  process,  it  becomes  a  Candidate  Project.  A  Can¬ 
didate  Project  "is  a  PRAM  project  proposal  for  which  a 
project  plan  has  been  developed  and  all  actions  necessary  to 
present  that  idea  to  the  PRAM  board  have  been  accomplished 
and  documented"  (14:3-2). 

The  PRAM  board  is  a  group  of  Air  Force  managers  who 
meet  as  necessary  to  approve  or  disapprove  the  expenditure 
of  PRAM  funds  necessary  to  underwrite  the  research  and/or 
development  of  Candidate  Projects.  For  projects  with  re- 
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search  and  development  costs  of  under  one  million  dollars, 
this  board  consists  of  senior  JTIP  and  PRAM  management. 
However,  once  the  cost  of  R&D  for  the  proposed  project 
exceeds  one  million  dollars,  the  Candidate  Project  must  be 
approved  or  disapproved  by  a  General  Officer's  Steering 
Group,  consisting  of  General  Officers  from  both  AFLC  and 
AFSC  (15:3) . 

Assuming  the  appropriate  board  approves  the  Candidate 
Project  for  full  scale  testing  and  evaluation,  it  now  be¬ 
comes  an  active  PRAM  project.  As  most  projects  require  con¬ 
tractor  support,  a  procurement  package  is  prepared  by  the 
appropriate  PRAM  project  manager.  Full  scale  testing  and 
evaluation  of  the  project  then  follows  (44). 

The  successful  testing  of  an  active  project  normally 
ends  PRAM's  responsibility  for  the  project,  as  PRAM'S 
charter  calls  only  for  the  research  and  development  of  any 
proposed  idea,  and  they  are  expressly  prohibited  from  spend¬ 
ing  any  funds  for  project  implementation.  The  ultimate 
implementation  of  any  successfully  demonstrated  project 
rests  with  the  using  command  (44). 

While  the  PRAM  board  considers  many  factors  in  ap¬ 
proving  or  disapproving  a  project,  their  decisions  reflect 
the  PRAM  board's  judgement  of  the  potential  for  each  Can¬ 
didate  Project  to  provide  tangible  benefits  to  the  Air  Force 
in  terms  of  reliability,  maintainability,  supportabi 1 l ty . 
and/or  cost  reduction.  The  decisions  are  made  based  on  the 
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information  presented  in  the  Project  Manager's  board  brief¬ 
ing.  If  the  Candidate  Project  does  not  show  the  potential 
for  improvements  in  any  of  these  areas,  there  is  almost  no 
chance  for  further  development  of  the  Candidate  Project. 

The  determination  of  whether  any  Candidate  PRAM  project 
becomes  an  active  project  depends  as  much  on  the  proper 
analysis  and  clarity  of  presentation  of  the  Candidate 
Project  to  the  PRAM  board  as  the  potential  benefits  of  the 
project  itself.  Although  the  project  manager  for  each 
Candidate  Project  must  take  many  qualitative  factors  into 
account,  at  some  point  during  the  investigation  estimates  of 
benefits  are  quantified  into  some  measure  of  merit. 

For  all  PRAM  Candidate  projects  the  primary  measure  of 
merit  is  useful  life  savings  (ULS) ,  a  quantitative  estimate 
of  the  tangible  cost  savings  to  the  Air  Force  over  the 
useful  life  of  the  improved  product  or  process  (14:D-3). 
However,  many  other  measures  of  merit,  such  as  estimates  of 
improved  reliability,  maintainability,  and  combat  capability 
are  often  considered  during  the  analysis  of  the  Candidate 
Project  and  can  directly  impact  the  final  decision  of  the 
PRAM  board . 

Although  most  of  these  estimates  are  presented  to  the 
PRAM  board  as  quantitative  estimates,  usually  in  terms  of 
ULS  expressed  as  a  dollar  amount,  they  are  arrived  at  by 
highly  qualitative  means.  While  this  has  proven  practical, 
it  has  often  left  the  project  managers  vulnerable  to  crit- 
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icisms  of  incomplete  analysis,  although  many  project  man¬ 
agers  argue  that  proper  analysis  of  Candidate  Projects  will 
always  involve  qualitative  factors  which  can  never  be  cap¬ 
tured  . 

Indeed,  many  of  the  qualitative  factors  of  the  PRAM 
decision  making  process  can  never  be  captured  using  quan¬ 
titative  methods.  It  is  also  a  fact  that  we  live  in  a 
uncertain  world,  and  performing  cost/benefit  analyses  on 
products  which  have  yet  to  be  fully  developed  for  military 
use  is  fraught  with  error  and  risk.  But  in  spite  of  the 
uncertainty  of  any  undertaking,  there  are  a  variety  of 
methods  used  to  attempt  to  quantitatively  analyze  the  costs 
and  benefits  of  projects. 

Nevertheless,  many  PRAM  project  managers  have  been 
disinclined  to  apply  quantitative  methods  to  program  anal¬ 
ysis.  The  unfortunate  result  may  be  that  decisions  to 
approve  or  disapprove  Candidate  Projects  may  be  based  on 
inaccurate  information,  leading  to  improper  allocation  of 
scarce  resources  or  missed  opportunities  for  improved  weapon 
systems  or  processes . 

Most  project  managers  within  the  PRAM  program  office 
would  welcome  any  tool  which  would  help  them  perform  a 
better  and  more  complete  analysis  of  Candidate  Projects.  As 
the  analysis  of  all  Candidate  Projects  involves  an  assess¬ 
ment  of  costs  and  benefits,  any  tool  which  can  provide  the 
project  manager  with  the  opportunity  to  rigorously  assess 
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the  benefits  and  perform  sensitivity  analyses  may  signifi¬ 
cantly  reduce  the  risk  of  ultimate  project  failure. 

Microcomputer-based  Logistics  Assessment  Models:  Analysis 
Tools 

Project  and  program  managers  in  the  PRAM  Program  Of¬ 
fice,  as  well  as  program  managers  throughout  the  Air  Force, 
seek  ever  better  ways  to  evaluate  t’neir  programs  and 
projects  in  an  effort  to  make  program  and  project  decisions 
which  assist  in  reaching  Air  Force  reliability  and  main¬ 
tainability  (R&M)  goals.  While  some  ideas  for  PRAM  projects 
have  been  so  well  thought  out  and  presented  that  their 
overwhelming  benefits  became  so  immediately  apparent  that 
they  did  not  require  any  in-depth  analysis,  most  have  been, 
and  continue  to  be,  fairly  complex,  requiring  an  analysis  of 
trade  offs  between  reliability,  costs,  manpower,  mobility, 
and  survivability  (17).  These  decisions  are  often  ill- 
structured  and  are  ideal  candidates  for  using  logistics 
support  mode  1 s . 

Blanchard  discusses  the  integration  of  models  with 
other  techniques  in  the  performance  of  logistics  support 
analysis  (LSA)  (4:148).  While  his  discussion  of  models  and 
analytical  techniques  focuses  primarily  on  more  complex 
logistical  analysis  tasks  than  the  supportabi 1 i ty  assess¬ 
ments  required  by  the  PRAM  office,  it  provides  a  good  in¬ 
sight  into  how  models  are  used  to  perform  such  analyses. 


21 


Blanchard  sees  models  as  analytical  tools  that  aid  in 
problem  solving.  Additionally,  models  should  facilitate  the 
logistics  support  decision  making  process.  Models  are 
important,  he  argues,  because  they  allow  the  analyst  to 
consider  alternative  solutions  to  the  problem  being  con¬ 
sidered  (4:148).  Other  benefits  that  he  ascribes  to  the  use 
of  models  in  the  LSA  process  include: 

1.  the  ability  of  the  model  to  integrate  several  in¬ 
dividual  elements  of  the  LSA  process  into  an  entire  system, 
thus  allowing  the  analyst  to  uncover  relationships  between 
data  elements  that  might  otherwise  go  unnoticed; 

2.  the  ability  to  "rapidly  and  efficiently"  compare 
several  different  problem  solutions; 

3.  the  ability  to  define  causal  relationships  ,  .at 
previously  went  unexplained; 

4.  a  fairly  quick  indication  of  data  needed  to  use  any 
given  mode  1 ; 

5.  the  ability  to  make  predictions,  as  well  as  evaluate 
"risk  and  uncertainty"  (4:149). 

For  all  the  potential  benefits  posed  by  the  use  of 
models,  however,  Blanchard  is  quick  to  note  that  their  use 
is  not  without  limitations.  First  and  foremost,  he  points 
out  that  models  are  only  tools  to  aid  the  decision  maker. 
They  do  not  make  decisions.  He  also  points  out  that  because 
of  the  unique  nature  of  many  logistical  problems,  the  anal¬ 
yst  may  have  to  develop  his  or  her  own  model  in  order  to 


completely  analyze  the  problem  at  hand.  This,  he  says,  is  a 
difficult  task,  even  under  the  most  ideal  circumstances 
(4 : 150) . 

An  important  problem  in  the  use  of  any  model  is  the 
amount  and  accuracy  of  the  data  used  in  the  operation  of  the 
model.  Unfortunately,  while  Blanchard  does  acknowledge  the 
immense  importance  of  this  step  in  the  successful  use  of  any 
model,  he  does  not  elaborate  at  all  on  the  severe  conse¬ 
quences  of  using  data  that  is  inaccurate  or  untimely. 

Blanchard's  treatment  of  models  was  intended  to  cover 
both  manual  and  computer-based  models.  Addi t iona 1 1 y ,  he  pro¬ 
vides  an  introduction  to  four  categories  of  problems,  in  the 
area  of  logistics,  that  computer-based  models  were  intended 
to  help  solve.  According  to  Blanchard,  these  categories 
inc 1 ude  .- 

1.  Conceptual  design  and  advanced  system  development. 

2.  Detail  equipment  design. 

3.  Determination  of  specific  logistical  support  re- 

qui rements . 

4.  Assessment  of  iocnstics  support  effectiveness 

f  4  .-  438-439  )  . 

While  discussing  specific  computer-based  logistics  sup¬ 
port  models.  Blanchard  elaborates  on  earlier  cautions  of 
model  use.  This  time,  however,  his  specific  focus  is  on  the 
pitfalls  and  abuses  of  computer-based  models.  He  warns  the 
analyst  against  attempting  to  use  an  "all-inclusive"  model, 
recommending  that  the  analyst  use  an  "integrated  set"  of 
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models  instead  (4:441).  Blanchard  sees  the  use  of  an  in¬ 
tegrated  set  of  models  as  a  clearly  superior  approach, 
because  It  provides  the  analyst  the  flexibility  to  solve  a 
wide  variety  of  problems.  However,  in  his  enthusiasm  for 
this  integrated  approach,  he  fails  to  address  the  problems 
of  additional  training  and  the  difficulty  of  model  main¬ 
tenance  that  such  an  approach  brings  to  the  LSA  process. 

Blanchard  also  warns  against  the  potential  danger  of 
"gross  oversimplification"  of  the  problem  through  the  use  of 
computer-based  models.  While  the  model  may  be  "mathe¬ 
matically  feasible,"  it  may  not  be  an  accurate  reflection  of 
reality.  The  end  result  might  be  a  model  which  does  not 
provide  the  analyst  or  decision  maker  with  any  useful  re¬ 
sults  (4.-441). 

The  last  caution  Blanchard  makes  regarding  these  com¬ 
puter-based  models  is  against  becoming  too  attached  to  any 
one  specific  model.  He  argues  that  there  is  a  tendency  for 
analysts  to  become  "so  attached"  to  a  specific  model  that 
"they  will  insist  that  the  model  is  the  real  world  and/or  is 
directly  applicable  to  all  problems  at  hand"  (4:442). 
Blanchard  again  warns  that  models  are  "only  a  tool"  for 
assistance  in  the  decision  making  process  "and  cannot  be 
considered  a  substitute  for  experience  and  judgement" 

(4:442) . 

Blanchard  finishes  his  discussion  on  computer-based 
models  by  giving  only  a  couple  of  examples  of  models  that 
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exist  for  problems  falling  into  logistics  support  or  assess¬ 
ment  categories.  While  he  briefly  describes  what  each  model 
accomplishes,  he  does  not  attempt  to  explain  the  relative 
merits  of  any  of  the  computer-based  models,  nor  does  he  give 
the  reader  many  clues  as  to  the  complexity  of  some  of  the 
mode  1 s . 

Drezner  and  Hillestad  also  discuss  models  and  their  use 
in  analyzing  logistics  support-ability.  Their  treatment  of 
this  area  was  more  specific  than  Blanchard's,  with  their 
focus  being  on  a  broad  review  and  analysis  of  the  roles  that 
models  have  in  solving  logistics  support  problems.  Addi¬ 
tionally,  they  discuss  future  trends  in  the  area  of  logis¬ 
tics  mode  Is  (16:1). 

As  Figure  1  illustrates.  Brezner  and  Hillestad  argue 
that  a  logistics  model  is  a  combination  of  methodologies  and 
measurements  as  they  apply  to  one  or  more  functional  areas 
of  logistics  support  (16:4).  This  combination  of  method¬ 
ologies  and  measurements  can  be  as  simple  as  a  single  ap¬ 
plication  of  a  methodology  and  measurement  to  one  functional 
logistics  area.  However,  as  weapon  systems  become  more 
technologically  complex,  more  often  a  logistical  model 
becomes  an  integrated  set  of  methodologies  and  measurements 
being  applied  to  a  cross  functional  set  of  logistics  support 
areas  (16:4-5) . 
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FUNCTIONAL  AREA 


METHODOLOGY 


*  Maintenance 

*  Supply/Inventory 

*  Transportation 

*  Communication 

*  Other  (procurement, 
basing,  facility  loca¬ 
tion  and  layout,  etc.) 


*  Simulation 

*  Mathematical 
programming 

*  Network  methods 

*  Decision  methods 

*  Statistical  and 
probability  methods 

*  Other  (heuristics, 
production  functions, 
etc. ) 


THE  LOGISTICS 
MODEL 


MEASURE  FUNCTIONS 


*  Individual  function  measures — 
e.g.,  fill  rate,  equipment  util¬ 
ization 

*  Cross  functional  peacetime 
measures — e.g.,  operational 
ready  rates 

*  Cross  functional  wartime  capa¬ 
bility  measures — e.g.,  combat 
capable  aircraft  available  to 
fly  as  a  function  of  time 


Figure  1.  The  Logistics  Model(16:4) 


Drezner  and  Hillestad  discuss  the  various  ways  models 
have  developed  and  have  been  used  in  each  of  the  functional 
areas.  In  doing  so,  they  raise  many  fundamental  issues  of 
the  use  of  models  in  the  logistics  support  arena,  and  sug¬ 
gest  several  areas  of  improvement.  They  are  concerned  that 
most  models  focus  too  narrowly  on  a  single  functional  logis¬ 
tics  area,  and  fail  to  capture  appropriate  relationships 
that  may  occur  between  functional  areas.  They  also  raise 
concerns  about  the  type  of  mathematical,  statistical,  and 
probability  assumptions  that  are  often  carelessly  generated 
during  model  development.  They  point  out  that  most  models 
built  for  logistics  support  assume  that  much  knowledge 
exists  concerning  various  expected  values  and  probability 
distributions  occurring  in  logistics  data,  when  in  fact  very 
little  is  known  about  many  of  these  data  probability  dis¬ 
tributions  (16:13) . 

Probably  the  most  important  issue  brought  out  concern¬ 
ing  logistics  models,  however,  is  their  peacetime-wartime 
dichotomy.  According  to  Drezner  and  Hillestad.  the  combined 
effects  of  a  "long  period  of  peacetime  activity  for  the 
military,  the  reduction  in  real  defense  appropriations,  and 
the  increasing  cost  of  sophisticated  weapon  systems"  re¬ 
sulted  in  the  development  of  a  host  of  models  with  emphasis 
on  "peacetime  efficiency"  (16:17).  This  emphasis  cn  peace¬ 
time  support  objectives  and  peacetime  efficiency,  however, 
conflicts  with  the  more  dynamic  logistical  support  require- 
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ments  that  almost  certainly  will  occur  in  war.  Drezner  and 
Hillestad  claim  that  much  more  emphasis  is  needed  in  devel¬ 
oping  models  which  will  account  for  the  logistical  support 
requirements  needed  for  a  variety  of  tactical  wartime 
scenarios  (16:18). 

While  developing  models  that  include  combat  capability 
measures  of  merit  is  indeed  a  very  important  task  for  future 
logistics  model  developers,  the  simple  fact  remains  that 
budget  constraints  and  economic  benefits  remain  important 
parts  of  any  good  analysis.  However,  Drezner  and  Hillestad 
devote  only  a  small  portion  of  their  article  to  discussing 
the  economic  aspects  of  logistics  models. 

This  analysis  of  logistics  models  assumes  that  the 
reader  knows  that  most  of  the  models  and  modeling  techniques 
discussed  require  the  use  of  computers  to  provide  the  anal¬ 
yst  with  any  concrete  benefit.  Nowhere  in  their  entire 
discussion  of  logistics  models  do  they  mention  the  need  to 
use  computers  to  run  most  of  the  logistics  models  currently 
1 n  use . 

Another  issue  that  Drezner  and  Hillestad  do  not  spend 
very  much  time  discussing  is  the  use  that  many  logistics 
support  models  make  of  dollar  costs  in  performing  analysis. 
Many  of  the  newer  logistics  support  models  uee  important 
measures  of  merit  other  than  cost.  While  these  newer  meas¬ 
ures  or  merit  (reliability,  maintainability,  and  combat 
capability)  are  extremely  important  in  the  supportabi 1 1 ty 
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decision  making  process,  the  fact  remains  that,  especially 
in  today's  budgetary  environment,  many  senior  Air  Force 
managers  are  interested  in  relating  reliability,  maintain¬ 
ability,  combat  readiness  and  mobility  measures  of  merit 
into  bottom  line  cost  figures.  This  is  especially  true  in 
the  PRAM  program  office,  where  currently  one  of  the  most 
important  quantitative  measures  used  in  evaluating  any 
project  is  the  useful  life  savings  the  project  is  expected 
to  accrue  and  comparing  that  to  the  initial  investment  that 
the  PRAM  office  will  have  to  make  in  developing  the  military 
application  of  the  technology. 

The  PRAM  Program  Office  calls  this  ratio  of  useful  life 
savings  to  investment  costs  the  return  on  investment  (ROI) 
accrued  by  the  project.  Although  this  definition  of  ROI  is 
unconventional  (traditionally  ROI  is  defined  as  the  monetary 
return  a  business  firm  in  the  private  sector  receives  in 
return  for  its  initial  dollar  investment,  expressed  as  an 
annual  percentage  rate),  it  adequately  expresses  the  idea  of 
logistics  analysis  performed  in  terms  of  economic  costs  and 
benefits . 

PRAM's  trade  off  analysis,  comparing  up  front  invest¬ 
ment  costs  against  projected  savings  in  operational  and 
support  costs  over  the  useful  life  of  a  project,  is  not  a 
new  idea.  For  over  fifteen  years  the  Air  Force,  as  well  as 
the  entire  Department  of  Defense,  has  been  concerned  with 
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performing  trade  off  analyses  of  weapon  system  acquisition 
costs  of  against  their  operational  and  support  costs. 

This  concept  is  now  commonly  referred  to  as  life  cycle 
cost  analysis.  Very  broadly  defined,  it  "refers  to  all 
costs  associated  with  the  system  and  or  product  and  applied 
to  the  defined  life  cycle"  (3:9).  Within  the  Air  Force,  the 
categories  of  life  cycle  costs  include  research  and  develop¬ 
ment  costs,  investment  costs,  and  operating  and  support 
costs  (31:11)  . 

Many  logistics  support  models  have  been  developed  in 
recent  years  that  attempt  to  perform  various  aspects  of  life 
cycle  cost  analysis.  In  1978,  Marks,  Massey,  and  Bradley 
performed  an  in-depth  evaluation  of  several  of  the  more  com¬ 
monly  used  life  cycle  costs  models  in  an  effort  to  help  ac¬ 
quisition  managers  contend  with  the  uncertainty  involved  in 
the  newly  emerging  field  of  life  cycle  cost  analysis  (31:v). 
While  this  report  (referred  to  as  the  Rand  report)  primarily 
focuses  on  how  the  various  life  cycle  cost  models  are  used 
in  the  acquisition  community  at  large,  the  observations, 
conclusions,  and  recommendations  of  the  Rand  report  are  very 
salient  to  any  serious  review  of  logistics  models. 

The  Rand  report  was  important  because  it  reported 
findings  concerning  problems  with  both  the  life  cycle  costs 
process  and  life  cycle  cost  models.  Unfortunately,  it  dis¬ 
cussed  data  collection  problems  for  these  models  only 
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briefly,  failing  to  address  the  consequences  of  collecting 
poor  data . 

Although  the  Rand  report  was  motivated  by  concerns  of 
how  aircraft  configuration  changes  and  modification  pro¬ 
posals  for  systems  were  evaluated  in  light  of  development, 
investment,  and  operational  and  support  costs,  it  soon 
turned  into  a  systematic  evaluation  of  the  entire  life  cycle 
cost  process  in  the  Air  Force  acquisition  community.  In 
their  attempt  to  evaluate  how  well  life  cycle  cost  models 
captured  various  elements  of  the  life  cycle  analysis 
process,  the  researchers  discovered  that  the  entire  life 
cycle  cost  process  was  not  clearly  defined  within  the  Air 
Force  acquisition  community.  One  of  the  primary  results  of 
this  finding  was  the  recommendation  to  classify  life  cycle 
costs  into  the  research  and  development,  investment,  and 
operating  and  support  categories,  along  with  various  sub¬ 
categories  (31:6)  . 

The  Rand  researchers  evaluated  six  of  the  most  commonly 
used  life  cycle  cost  models  in  use  at  the  time.  Figure  2 
describes  each  model  evaluated.  This  figure  briefly  ex¬ 
plains  the  classification  of  each  model,  its  main  purpose, 
and  the  relevant  strengths  and  weaknesses  of  each  model  as 
highlighted  in  the  Rand  Report. 

The  Rand  report  was  critical  of  ail  life  cycle  cost 
models  they  evaluated.  In  their  conclusion  they  stated: 
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The  principal  message  that  emerges  from  our  research  is 
that  current  LCC  models  contain  many  shortcomings  that 
limit  their  usefulness  for  life  cycle  analysis  of  major 
modification  proposals  or  other  applications  requiring 
estimates  of  absolute  incremental  cost  (31:40-41). 

Additionally,  they  concluded  the  primary  reason  that  the 
models  were  flawed  in  many  areas  was  because  they  either 
poorly  addressed  causal  relationships  and  cost  driving 
factors  of  many  of  the  life  cycle  cost  variables  or  failed 
to  address  them  all  together. 

How  did  they  suggest  the  logistics  support  analyst 
handle  this  dilemma?  Their  conclusion  in  light  of  the 
previous  finding  was  rather  straightforward.  They  recom¬ 
mended  : 

When  the  evaluations  (of  the  six  models)  indicate  that 
a  proposal's  principal  cost  driving  factors  and  cost 
elements  are  addressed  poorly  (or  not  at  all)  the 
models  should  be  used  cautiously,  and  any  cost  savings 
predicted  should  be  strongly  supported  by  additional 
analysis  or  empirical  evidence  (31:41). 

One  of  the  critical  assumptions  the  Rand  report  seemed  to 
infer  was  that  most  life  cycle  cost  studies  needed  to  make 
absolute  incremental  cost  estimates  (31:40).  Often,  as  in 
the  case  of  the  PRAM  Program  office,  this  assumption  does 
not  hold.  Unfortunately,  while  acknowledging  that  life 
cycle  cost  studies  may  be  undertaken  with  only  an  interest 
in  relevant  or  approximate  cost  estimates,  the  Rand  re¬ 
searchers  do  not  address  the  issue  of  the  appropriate  use  of 
these  models  in  making  any  rough  LCC  estimates. 
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During  the  course  of  this  study,  the  researchers  dis¬ 
covered  that  obtaining  the  appropriate  input  data  for  these 
life  cycle  cost  models  proved  to  be  a  very  daunting  task 
indeed,  while  optimistically  stating,  "with  sufficient 
effort  and  time,  it  should  be  possible  to  overcome  the  main 
methodological  problems  and  data  deficiencies  of  life  cycle 
cost  analysis"  (31:42).  Eleven  years  later,  however,  the 
problem  of  serious  data  deficiencies  is  still  a  very  sig¬ 
nificant  problem  in  life  cycle  cost  analysis.  It  is  a 
problem  that  has  very  broad  implications  for  the  use  of  life 
cycle  cost  models  as  well  as  a  host  of  other  logistics 
models.  Unfortunately,  this  problem  seems  to  be  one  that  is 
rather  intractable. 

Another  issue  that  the  Rand  researchers  did  not  concern 
themselves  with  was  the  issue  of  man/model  interface.  Al¬ 
though  they  criticized  the  models  heavily  for  not  capturing 
the  proper  cost  driving  factors  or  cost  element  relation¬ 
ships,  they  did  not  discuss  the  amount  of  training  needed  by 
analysts  to  properly  interface  with  each  model.  The  only 
hint  of  this  problem  comes  when  they  discuss  the  bulky 
nature  of  the  Logistics  Composite  (LCOM)  model,  and  the 
large  number  of  inputs  it  requires  (31:25). 

One  issue  that  logistics  modeling  literature  did  not 
address  before  the  1980s  was  the  issue  of  model  portability. 
Additionally,  the  issue  of  using  logistics  models  on  various 
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computer  systems  has  received  attention  only  in  the  most 
recent  literature. 

These  issues,  as  well  as  a  host  of  others  concerning 
the  use  of  logistics  models  on  computer-based  systems, 
surfaced  as  a  direct  result  of  the  introduction  of  inexpen¬ 
sive  and  powerful  microcomputers  during  the  early  and  mid- 
1980s.  Prior  to  this  major  technological  advancement,  the 
use  of  logistics  models  required  interface  with  computer 
systems  groups,  management  information  services  personnel, 
or  other  data  processing  departments  (40:39).  The  develop¬ 
ment  of  logistics  models,  prior  to  the  introduction  of  the 
microcomputers,  was  always  a  prolonged  and  expensive  task, 
requiring  the  efforts  of  many  programmers  and  extensive 
mainframe  computer  resources.  As  a  result,  computer-based 
logistics  support  analysis  was  often  a  complex  task  and  many 
early  attempts  at  using  computers  to  perform  this  type  of 
analysis  were  eventually  abandoned  (44). 

These  early  failures  soured  many  logistics  support 
analysts  on  the  use  of  models  and  computers  for  performing 
any  logistics  support  analysis.  Genet's  and  Demmy ' s  advice 
to  new  logistics  analysts  concerning  the  use  of  computers 
and  logistical  models  is  thought  to  be  an  example  of  this 
earlier  frustration.  They  warn  the  new  analyst  to  be  ex¬ 
tremely  cautious  when  using  the  computer  tc  perform  logis¬ 
tics  support  analysis.  They  state: 
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Be  forewarned  that  (computer)  programs  take  five  times 
as  long  to  write  as  planned.  Computer  programs  never 
work  right  the  first,  second,  third  or  forth  time. 
Computers  always  go  down  when  you  need  them  most 
(20:39). 

Additionally,  in  warning  against  the  use  of  computerized 
logistics  models,  these  authors  declare: 

Be  informed  that  canned  simulation  models  always 
reguire  lots  of  input  data  that  you  will  not  be  able  to 
get  no  matter  how  hard  you  try  (so  you  will  end  up 
guessing).  Also  be  informed  that  canned  models  usually 
contain  hidden  undocumented  critical  assumptions  that 
will  leap  out  and  grab  you  at  the  last  moment,  when 
it's  too  late  to  recover  (20:39). 

These  warnings  against  what  Genet  and  Demmy  call  the 
"twin  diseases  of  computeritis  and  modelitis"  are  very 
important.  The  improper  use  of  computers  and  canned  models 
by  novice  analysts  can  lead  to  improper  analysis  and  poor 
decisions.  However,  implied  in  these  warnings  was  a  sense 
of  frustration  experienced  by  many  logisticians  concerning 
the  complexity  of  using  these  large  models  on  the  existing 
computer  mainframe  technologies  of  the  1970s. 

The  introduction  of  inexpensive  microcomputers  with 
very  large  and  powerful  memories  overcame  many  techno  1 og i ca 1 
barriers  that  previously  existed  in  logistics  model  develop¬ 
ment  efforts.  Additionally,  along  with  the  introduction  of 
this  new  microcomputer  hardware,  came  a  host  of  improvements 
in  application  software.  The  end  result  has  been  a  devel¬ 
opment  of  an  entire  new  generation  of  general  and  specific 
computer  software  that  allows  the  logistics  support  analyst 
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and  program  manager  to  more  readily  take  advantage  of  the 
logistics  support  modeling  environment. 

The  variety  of  microcomputer  tools  now  available  for 
use  by  the  logistics  support  analyst  covers  a  very  broad 
spectrum  from  simple  spreadsheets  to  more  complex  programs 
which  use  cost  estimating  linear  regressions  and  probability 
distributions  to  represent  historical  data.  These  new  tools 
have  given  the  analyst  ever  increasing  flexibility  in  per¬ 
forming  supportabi 1 ity  analysis  of  complex  weapon  systems. 
Additionally,  these  new  software  applications  require  little 
or  no  computer  expertise  to  operate.  As  a  result  many 
logistics  analysts,  program  managers,  and  even  senior  Air 
Force  managers  are  beginning  to  use  microcomputers  to  assist 
them  in  tactical  and  strategic  decision  making.  As  micro¬ 
computers  become  even  more  powerful  and  the  software  becomes 
even  easier  to  use.  there  is  little  doubt  that  this  trend 
will  cont i nue . 

As  a  result  of  relent  technological  advances,  a  con¬ 
tinuum  of  logistics  support  microcomputer  models  has  devel¬ 
oped  within  the  last  five  years.  As  Figure  3  illustrates, 
the  range  and  scope  of  models  that  exists  along  this  con¬ 
tinuum  varies  from  tailored  models  designed  by  analysts 
using  existing  commercial  software  products  to  composite 
modeling  efforts  designed  to  more  completely  integrate 
functional  logistics  areas  with  different  functional 
measures  of  merit. 
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Green  provides  the  reader  with  one  example  of  a 
tailored  model  through  his  use  of  a  standard  commercial 
spreadsheet  package  to  perform  simple  life  cycle  cost  anal¬ 
ysis  (22:33).  He  took  advantage  of  simple  spreadsheet 
modeling  methods  and  several  financial  functions  built  in  to 
the  spreadsheet.  The  result  was  a  s imp  1 e-to-use .  customised 
life  cycle  cost  model  which  allowed  the  user  to  quickly  com¬ 
pare  the  life  cycle  costs  of  several  alternatives  and  easily 
change  any  factor  in  the  model  in  order  to  perform  sen¬ 
sitivity  analysis.  Additionally,  it  was  designed  to  capture 
the  net  present  value  of  the  various  alternatives  examined, 
allowing  the  decision  maker  to  evaluate  all  projects  in 
light  of  current  dollars  (22:34). 

Green  assumes  that  most  analysts  will  be  familiar 
enough  with  microcomputer  applications  so  that  learning  hew 
to  use  a  spreadsheet  will  not  be  difficult.  He  concludes  by 
stating  "spreadsheet-based  life-cycle  analysis  can  yield  a 
valid  result  with  a  reasonable  amount  of  investment  of  time 
and  energy"  (22:36).  This  common  microcomputer  application 
can  become  a  useful  tool  for  the  logistics  support  analyst 
in  only  a  matter  of  days,  allowing  the  analyst  to  perform 
not  only  accurate  life-cycle  cost  analysis,  but  a  host  of 
other  logistics  support  studies  that  use  complex  mathemati- 
ca 1  f  ormu 1  as . 

Many  other  tailored  logistics  models  have  been  devel¬ 
oped  by  a  variety  of  Air  Force  analysts.  As  microcomputer 
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application  software  becomes  more  oriented  to  business  and 
government  managers  as  their  primary  customers  (as  opposed 
to  computer  science  professionals),  the  traditional  distinc¬ 
tions  between  the  managers  as  end  users  of  models  and  man¬ 
agers  as  model  builders  has  often  become  blurred.  End-user 
model  development  allows  the  logistics  support  analyst  to 
bypass  many  developmental  difficulties,  in  terms  of  time  and 
effort,  that  exist  by  using  more  traditional  Air  Force 
methods  of  software  development. 

The  Air  Force  is  actively  encouraging  this  user-devel¬ 
oped  software  modeling  effort  in  assisting  decision  makers 
efforts  to  solve  a  wide  variety  of  logistics  support  prob¬ 
lems.  To  further  this  effort,  the  recently  established 
Information  Systems  Technology  Application  Program  (I3TAP) 
was  developed  to  "advocate  the  use  of  commercial  software, 
programming  aids,  and  end-user  development  to  facilitate 
(Air  Force)  software  production"  (46:22).  The  ISTAP  hopes 
to  have  over  50  percent  of  all  new  Air  Force  software  user- 
developed  by  the  end  of  FY  1989  (46:22). 

Not  only  has  the  microcomputer  revolution  produced  a 
wide  range  of  user-developed  models,  it  has  been  responsible 
for  a  host  of  more  sophisticated  models  which  seek  to  im¬ 
prove  logistics  support  analysis  in  different  functional 
logistics  support  areas.  Examples  of  microcomputer  models 
developed  for  specific  functional  logistics  support  areas 
are  the  recently  developed  Aircraft  Availability  Model 
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(AAM) ,  a  microcomputer  version  of  a  supply  spares  provi¬ 
sioning  model  and  the  Automated  Air  Load  Planning  System 
(AALPS) ,  a  microcomputer  version  of  a  transportation  expert 
system  designed  to  assist  military  transporters  in  cal¬ 
culating  cargo  load  requirements  for  air  transport  (25:2-1). 

In  addition  to  the  functional  logistics  models,  one 
finds  logistics  models  designed  to  capture  a  single  measure 
of  merit  over  a  wide  variety  of  functional  logistics  areas. 
While  many  of  these  models  are  more  complex  than  those 
designed  to  measure  a  single  functional  logistics  area,  as 
Figure  3  illustrates,  there  are  no  distinct  boundaries 
separating  these  two  categories.  Among  some  of  the  most 
widely  used  models  in  this  measure  of  merit  category  are  a 
number  of  models  which  are  designed  to  capture  weapon  system 
and  subsystem  life  cycle  costs. 

In  the  life  cycle  cost  arena,  two  relatively  new  micro¬ 
computer-based  life  cycle  cost  models  which  are  representa¬ 
tive  of  this  type  of  model  are  the  Statistically  Improved 
Life  Cycle  Cost  (SILCC)  model  and  the  Cost  Analysis  and 
Strategy  and  Assessment  (CASA)  model.  Although  both  are 
microcomputer  based,  they  vary  widely  in  scope. 

The  SILCC  was  designed  primarily  to  provide  Air  Force 
logistics  support  analysts  and  program  managers  with  the 
ability  to  perform  life  cycle  cost  trade  off  analysis  down 
to  the  subsystem  and  component  level  (46:2).  It  was 
designed  to  calculate  a  wide  range  of  life  cycle  costs. 
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primarily  focusing  on  operational  and  support  costs,  but 

evaluating  all  life  cycle  costs.  It  requires  only  36  data 

inputs  for  each  alternative  being  evaluated,  and  provides 

the  user  with  19  outputs  for  each  alternative.  These  output 

categories  are  divided  into  four  categories;  numbers  of 

spares  required,  number  of  maintenance  hours  required, 

expenditures,  and  total  life  cycle  costs  (37:26,30). 

CASA,  on  the  other  hand,  is  a  more  complex  life  cycle 

cost  model  designed  to  be  used  by  a  wide  range  of  program 

managers  and  logistical  analysts  throughout  the  Department 

of  Defense  (25:30).  The  CASA  model: 

provides  automated  support  for  LCC'  estimates,  trade-off 
analysis,  repair  level  analyses,  production  rate  and 
quantity  analysis,  warranty  analyses,  spares  identifi¬ 
cation,  resource  pro ject ions (ma l ntenance  planning), 
risk  and  uncertainty  analysis,  cost  driver  sensitivity 
analysis,  reliability  growth  analysis,  evaluation  of 
engineering  change  proposals,  operational  availability 
analysis,  spares  optimization,  and  design  to  life  cycle 
cost  studies  (25:30). 

This  model  has  six  major  modules  and  was  designed  to  run  on 
an  IBM-compatible  microcomputer.  The  development  and  use  of 
this  complex  LCC  cost  model  on  a  standard  microcomputer 
would  not  have  been  possible  less  than  a  decade  ago. 

The  most  recent  advancement  of  logistics  support  model 
technology  is  composite  modeling.  Composite  modeling  seeks 
to  combine  two  or  more  logistics  support  models  into  a 
single,  integrated  model  in  an  effort  to  capture  causal 
relationships  between  several  different  measures  of  merit. 
Within  the  military,  composite  modeling  also  attempts  to 
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bridge  the  current  gap  between  peacetime  efficiency  models 
and  those  models  that  attempt  to  assess  the  wartime  logis¬ 
tics  support  capabilities. 

Two  models  which  are  representative  of  recent  composite 
modeling  efforts  are  the  System  Cost  Operational  Performance 
for  Modification  (SCOPE-MOD)  model  and  the  Logistics  Assess¬ 
ment  Methodology  Program/Logistics  Assessment  Work  Station 
(LAMP/LAWS).  Beth  of  these  models  are  integrated  composites 
of  other  complete  models.  Both  models  were  also  designed  to 
integrate  all  five  of  the  Air  Force's  R&M  2000  goals  into  a 
single  model  to  allow  an  Air  Force  program  manager  to  per¬ 
form  trade  off  analysis  between  warfighting  capability, 
survivability,  mobility,  manpower,  and  life  cycle  costs 
l 39:1-1:45:45) . 

SCOPE-MOD  was  designed  to  provide  logistics  support 
analysts  with  a  comparative  model  that  evaluates  how  "pro¬ 
posed  R&M  modifications  will  enhance  R&M  2000  goals"  (39:1- 
2) .  It  is  the  combination  of  two  distinct  models,  DYNAMOD 
and  MICROSTRAT. 

DYNAMOD.  a  "logistical  pipeline  model",  was  designed 
using  the  same  methodology  developed  for  the  popular  DYNA- 
METRIC  spares  provisioning  model  produced  by  the  Rand  Cor¬ 
poration  (39:B-2).  Designed  to  determine  warfighting  im¬ 
provements  of  proposed  R&M  alternatives  at  the  squadron 
level,  it  uses  R&M  data,  spares  data,  and  typical  wartime 
flying  scenarios  to  predict  30-day  aircraft  availability  and 
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sortie  rates  at  the  squadron  level  for  a  variety  of  weapon 
systems  ( 39 : 2-4) . 

The  second  model  integrated  into  SCOPE-MOD,  MICROSTRAT, 
computes  weapon  system  life  cycle  costs.  The  model  computes 
both  investment  and  annual  operating  costs  for  a  two  dif¬ 
ferent  sets  of  components;  the  baseline  set  and  the  modified 
set.  The  resulting  output  compares  both  the  annual  and 
cumulative  life  cycle  costs  of  the  weapon  system  baseline 
component  set  to  tne  same  weapon  system  with  the  modified 
component  set  (39;D-2). 

Like  SCOPE-MOD,  LAMP/LAWS  is  a  composite  modeling 
effort  that  integrates  several  models  in  an  effort  to  pro¬ 
vide  a  complete  REM  2000  goals  assessment.  Unlike  SCOPE- 
MOD,  however,  LAMP/LAWS  integrates  six  previously  accepted 
DOD  logistics  support  models  in  its  effort  to  capture  all  of 
the  REM  measures  of  merit  (24).  Figure  4  lists  and  briefly 
describes  the  six  models  used  for  calculating  LAMP/LAWS 
outputs . 

Since  the  introduction  of  practical  microcomputer  tech¬ 
nology,  the  pace  of  both  hardware  and  software  developments 
has  been  astounding.  Both  hardware  and  software  technology 
are  often  obsolete  within  a  year  after  they  are  introduced. 
Microcomputer  technology  is  in  a  continual  state  of  flux, 
with  new  hardware  and  software  products  being  developed 
almost  weekly. 
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Figure  4.  Accepted  DOD  Models  Integrated  into  the  I.AMP/I.AWS  Composite  Model  (27) 


This  state  of  rapidly  changing  microcomputer  technology 
has  been  probably  one  of  the  key  factors  in  the  substantial 
growth  of  composite  logistics  models.  While  still  a  very 
complex  process,  the  time  needed  to  integrate  complete 
logistics  models  into  a  single  composite  package  has  de¬ 
creased  exponentially.  During  a  recent  logistics  support 
conference,  one  model  developer  recently  pointed  out  that 
his  company's  first  effort  at  composite  modeling  took  about 
ten  months.  Less  than  two  years  later,  the  time  this  same 
company  needed  to  develop  a  composite  modeling  package  was 
less  than  three  months  (26). 

While  this  rapid  growth  in  modeling  capability  is 
touted  by  the  model  developers  as  a  great  boon  for  analysts 
and  decision  makers  alike,  it  also  has  some  very  distinct 
disadvantages.  Probably  one  of  the  biggest  drawbacks  is  the 
large  delay  created  between  model  development  and  indepen¬ 
dent  model  validation. 

As  with  any  analytical  tool  designed  to  aid  decision 
making,  microcomputer  logistics  support  models  will  not  gain 
widespread  acceptance  from  those  responsible  for  performing 
supportabi  1  i*''  - ->  •»  1  -i  <3  unless  fh°v  can  be  used  with  some 
known  degree  of  confidence.  Ideally,  model  developers  con¬ 
front  this  confidence  issue  through  verification  and  valida¬ 
tion  (38:33).  Verification  is  the  process  of  ensuring  the 
software  operates  properly  and  its  implementation  of  the 
model  is  conceptually  correct.  While  this  process  may  be 
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complex  and  time  consuming,  it  is  the  rather  stra ight f orward 
task  of  ensuring  that  the  computer  programming  faithfully 
reproduces  the  algorithms  and  procedures  of  the  model 
(38:33).  This  task  pales,  by  comparison,  to  the  more 
difficult  job  of  model  validation. 

Model  validation  is  the  process  of  making  sure  that  the 
"working"  computer  model  captures  the  real  system  adequately 
enough  for  use  in  problem  solving  (5:5-5).  While  there  are 
many  different  ways  to  validate  model.  Hal  lam,  et  al., 
define  five  general  steps  of  proper  model  validation.  They 
include : 

1.  Establishing  goals  and  assumptions  of  (the)  model  in 
writing. 

2.  Test  (the)  rationality  of  the  assumptions. 

3.  Test  (the)  statistical  validity  of  crucial 
assumptions . 

4.  Compare  model  output  to  historical  output. 

5.  Test  validity  of  predictions  (23:83). 

Hal  lam  goes  on  to  make  an  extremely  important  point 
about  models.  While  specifically  addressing  simulation 
models,  the  comments  made  in  this  article  apply  to  micro¬ 
computer-based  models  as  we  1 1 .  In  making  an  analogy  between 
simulation  models  and  toys,  Hal  lam  asserts: 

A  model  without  validity  may  . . .  bear  some  resemblance 
to  its  real  counterpart .  but  it  too  is  useless  except 
perhaps  to  delight  or  entertain.  Without  proper  valid¬ 
ation,  the  computer  model  is  merely  a  toy"  (23:83). 
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If  the  model  is  merely  useless,  there  would  be  little 
cause  for  alarm.  However,  when  an  invalid  model  is  assume,' 
to  be  valid  by  the  decision  maker,  they  can  become  dan¬ 
gerous.  Again,  Hal  lam  contends: 

Computerized ..  .mode  1 s  are  particularly  dangerous  be¬ 
cause,  for  many  persons,  output  from  the  computer  is 
automatically  considered  accurate.  The  danger  arises 
when  the  decision-maker  assumes  the  toy  is  valid  and 
bases  decisions  accordingly  (23:83). 

The  bottom  line  on  model  validation  is  gaining  the  con¬ 
fidence  of  the  user  community  that  the  model  can  reasonably 
accomplish  its  intended  tasks  over  a  wide  range  of  analysis. 

Because  of  the  difficulty  inherent  in  validation,  only 
a  few  microcomputer  models  have  reached  the  broadest  level 
of  acceptance  within  the  use  community.  While  many  micro¬ 
computer  models  have  their  own  individual  champions,  many 
analysts  are  skeptical  of  the  validity  of  many  of  these 
newly  developed  microcomputer  models. 

Contributing  to  this  skepticism  is  a  general  lack  of 
formal  studies  that  thoroughly  document  the  overall 
strengths  and  weaknesses  of  these  models.  Additionally, 
fewer  still  actually  discuss  the  mathematical  or  statistical 
validity  of  microcomputer  models.  Most  of  the  documents 
this  thesis  author  was  able  to  uncover  concerning  computer 
validity  were  manuals  or  guides  published  by  the  contractors 
responsible  for  developing  the  models.  These  reports  concen¬ 
trated  more  on  discussing  the  virtues  of  the  model  and  their 
specific  mathematical  and/or  linear  regression  formu.  .3  than 
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specific  validity  issues.  While  these  contractor  manuals 
may  indeed  help  to  validate  the  model,  the  user  community 
will  more  readily  accept  a  model  that  has  been  independently 
validated.  Unfortunately,  independent  formal  case  studies 
on  specific  microcomputer  models  are  difficult  to  uncover. 

Tovrea  accomplished  one  such  study  on  LAMP/LAWS.  The 
purpose  of  his  research  was  to  demonstrate  the  validity  of 
LAMP/LAWS  as  an  assessment  tool  for  the  potential  modifi¬ 
cation  of  a  specific  subsystem  on  the  F-15  aircraft 
(45:2-3).  After  gathering  a  considerable  amount  of  sup- 
portability  data  on  two  different  versions  of  the  AN/ALQ-135 
Internal  Countermeasures  Set,  Tovrea  first  used  LAWS  to 
perform  direct  pertormance  comparisons  of  the  original 
configuration  of  the  AN/ALQ-135  with  the  proposed  modifica¬ 
tion,  across  the  five  R&M  measures  of  merit.  He  then  per¬ 
formed  extensive  amounts  of  sensitivity  analysis  to  ascer¬ 
tain  what  changes  LAMP/LAWS  predicted.  For  example,  if  he 
made  reductions  to  the  amount  of  aircraft  available  because 
to  wartime  attrition,  he  wanted  to  see  how  LAMP/LAWS  would 
predict  a  reduction  of  combat  capability  as  well  as  a  reduc¬ 
tion  in  the  number  of  spares  required  (45:131). 

Tovrea  was  able  to  use  LAMP/LAWS  to  make  a  wide  variety 
of  supportab i 1 1 ty  assessments  about  the  original  configura¬ 
tion  of  the  AN/ALQ-135  versus  the  proposed  modification. 
Based  on  the  output  from  the  LAMP/LAW'3  model,  he  concluded 
that  the  proposed  modification  offered  large  supportabi 1 i ty 
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improvements  over  the  existing  conf igurat ion  in  every  R&M 
2000  goal  except  life  cycle  cost  (45:154).  Additionally,  he 
was  able  to  conclude,  based  on  LAMP/LAWS  outputs,  how 
changes  in  maintenance  policy,  levels  of  support  equipment, 
repair  cycle  time,  and  mean  time  between  failure  of  the  two 
different  alternatives  would  affect  all  five  R&M  2000  goals. 

While  Tovrea  was  able  to  use  LAMP/LAWS  to  perform  a 
very  comprehensive  supportabi 1 lty  assessment  of  two  alter¬ 
native  subsystems  of  the  F-15  aircraft,  he  also  concluded 
that,  for  its  stated  purpose  of  supportabi 1 i ty  assessment, 
the  model  was  incomplete  as  he  had  used  it.  While  he  noted 
the  model  which  he  used  was  a  prototype,  there  were  still 
software  "glitches"  that  constrained  the  analysis  process 
(45:149).  Of  particular  importance  was  his  note  that  "some 
of  the  input  variables  were  inexplicably  ' unsens i t i zab 1 e ' 
due  to  unexpected  dead  ends  in  the  'What-if'  options" 
(45:149).  This  prevented  him  from  performing  a  number  of 
sensitivity  analyses,  which  may  or  may  not  have  affected  the 
final  overall  analysis.  He  also  noted  that  some  variables 
in  LAMP/LAW3  were  either  defined  vaguely  or  incorrectly 
(45 : 149  )  . 

Another  issue  pointed  out  by  Tovrea  was  the  tremendous 
effort  needed  to  accumulate  enough  data  to  properly  run 
LAMP/LAWS.  While  he  noted  that  a  positive  benefit  of  the 
data  collection  effort  was  a  better  understand i ng  of  the 
"assumptions  and  real-world  factors  underlying  the  data". 
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one  might  just  as  well  argue  that  if  the  true  purpose  was  to 
make  LAMP/LAWs  a  truly  effective  tool  in  aiding  the  decision 
making  process,  the  model  developers  should  have  spent  more 
time  and  effort  making  the  data  collection  process  less 
painful  (45:57).  The  model  developer  did  indeed  take  note 
of  this  data  collection  issue,  and  developed  a  data  pre¬ 
processor  for  LAMP/LAWS  in  order  to  greatly  simplify  the 
data  collection  effort. 

Minmck  accomplished  another  model  validation  study 
which  performs  model  validation  by  comparing  the  output  of 
two  similar  mi crocomputer-based  life  cycle  cost  models  using 
the  same  input  data  (33:331).  He  compared  the  results  of 
the  Cost  Analysis  and  Strategy  Assessment  (CASA)  model  with 
a  version  of  the  Logistics  Support  Cost  Model  (LSC)  that  has 
been  adapted  to  capture  all  relevant  life  cycle  costs 
(33:331) . 

Minmck  constructed  hypothetical  data  sets  for  a 
generic  infrared  detecting  system  that  was  supposed  to  have 
a  useful  system  life  of  20  years.  When  he  ran  both  models 
using  the  same  input  data  set  at  the  beginning  of  the  study. 
Minmck  noted  that  the  difference  in  bottom  line  LCC  costs 
between  CASA  and  LSC  was  over  $67  million  dollars  (a  23.1 
percent  difference  in  total  LCC)  (33:334).  Even  after 
making  changes  to  the  input  data  in  an  effort  to  achieve 
dura  parity  between  the  two  models,  the  end  results  were 
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still  over  $37.5  million  dollars  apart  (a  13.4  percent 
difference  in  total  LCC)  (33:334). 

Not  only  did  the  models  differ  with  respect  to  bottom 
line  life  cycle  costs,  they  offered  differing  levels  of  sen¬ 
sitivity  analysis.  For  example,  in  CASA,  if  the  mean  time 
between  failure  (MTBF)  was  decreased  by  10  percent,  the 
effect  on  LCC  was  a  7.8  percent  increase.  By  contrast,  the 
same  10  decrease  in  MTBF  in  LSC  caused  more  than  a  10  per¬ 
cent  increase  in  reported  LCC  (33:334). 

Minnick  noted  that  the  key  reason  for  the  variations 
between  these  two  models  was  due  to  the  differing  assump¬ 
tions  made  about  aircraft  flying  hours.  CASA  used  a  ‘'phase- 
in"  approach  to  aircraft  hours  at  the  system  level;  it 
assumed  that  not  all  of  the  aircraft  would  be  available  for 
operational  use  at  the  beginning  of  the  life  cycle.  LSC.  on 
the  other  hand,  assumed  that  all  air -raft  were  available 
from  the  beginning  of  the  weapon  system  life  cycle.  It  did 
not  assume  any  build  up  of  activity  over  a  period  of  time. 
The  difference  between  these  two  assumptions  was  over 
142.000  operating  hours  over  a  twenty  year  period;  CASA 
having  amassed  3,600,000  operating  hours  versus  3.457,500 
operating  hours  for  LSC  (a  4  percent  difference)  (33:335). 

Other  differing  assumptions  caused  similar  disparities 
for  a  host  of  other  operational  and  support  ( O&S )  cate¬ 
gories.  These  differing  assumptions  caused  over  a  24  per¬ 
cent  variance  between  equipment  maintenance  costs,  a  12 


5  2 


percent  variance  between  condemnation  spares  costs,  a  9 
percent  variance  between  pipeline  spare  costs,  as  well  as 
similar  variances  in  a  wide  range  of  other  0&'d  costs 
(33 : 335)  . 

Although  Minnick  points  out  O&S  costs  differences  in 
various  categories,  except  for  citing  the  reason  for  the 
differences  in  operating  hours,  he  does  not  clearly  indicate 
why  he  thinks  the  cost  numbers  were  so  different.  Addition¬ 
ally,  after  spending  the  bulk  of  his  article  addressing  the 
output  differences  between  the  two  models,  he  ends  by 
arguing  that  "both  models  produce  reasonable  results" 
(33:336).  However,  he  does  not  explain  what  he  means  by 
this  statement,  except  to  say  "both  models  have  applications 
in  training,  conceptual  work,  and  full-scale  development 
phases  for  equipment  that  functions  in  an  operating  environ¬ 
ment".  One  can  only  assume  that  Minnick  is  suggesting  that 
for  preliminary  LCC  cost  estimates  both  models  are  adequate. 
Additionally,  Minnick  clouds  the  model  validation  issue  by 
stating  that  CASA  was  more  robust  than  LSC ,  without  explain¬ 
ing  his  rationale  tor  this  statement. 

The  Supportabi 1 i ty  Investment  Decision  Analysis  Center 
fSIDAC) :  Making  Sense  of  Microcomputer  Logistics  Support 
Mode  1 s 

While  the  issue  of  validity  is  fundamental  to  model 
use,  with  the  recent  explosion  m  the  amount  of  micro 
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computer-based  logistics  support  models  available,  even  a 
more  basic  concern  for  many  logistics  analysts  and  decision 
makers  has  been  simply  how  to  obtain  enough  information  on 
existing  models  to  make  rational  decisions  concerning  their 
applicability  and  use.  Many  analysts  within  the  Air  Force 
supportabi 1 ity  community  simply  do  not  know  where  to  start 
looking  for  inf  c  .-“mat  ion  concerning  quality  supportabi  1  i  ty 
analysis  methodology,  data  or  models  needed  to  perform  more 
complete  analyses. 

Supportabi 1 i ty  managers  and  analysts  throughout  the  Air 
Force  have  been  seriously  concerned  about  these  deficiencies 
in  supportabi 1 l ty  assessment.  Because  of  these  concerns . 
the  Air  Staff,  along  with  many  separate  agencies  within  AFLC 
and  AFSC.  have  recently  undertaken  many  separate  efforts  to 
improve  the  quality  of  supportabi 1 i ty  analysis  and  decision 
making  (8:1). 

During  the  1988  AFLC  Logistics  Operations  Center's 
(LOC)  R&M  Modeling  Conference,  many  of  these  efforts  were 
examined  and  evaluated.  One  "overwhelming  recommendation" 
emerging  from  this  conference  was  an  initiative  to  study  the 
feasibility  of  establishing  a  joint  AFLC/AFSC  supportabi I l ty 
analysis  center  (9:2).  Through  the  development  of  the 
Supportabi 1 l ty  Investment  Decision  Analysis  Center  (SIDAC). 
both  AFLC  and  AFSC  hope  to  "improve  and  apply  analysis 
methods,  models,  and  techniques,  and  enabling  services  for 
every  aspect  of  weapon  system  supportabi 1 l ty"  (9:1). 


5d 


Although  this  center  is  only  in  the  Concept  Exploration 
stage,  if  the  concept  proves  feasible,  the  SIDAC  eventually 
will  provide  a  wide  variety  of  services  to  supportabi 1 ity 
analysts . 

Proposing  to  function  along  the  lines  of  traditional 
DOD  Information  Analysis  Centers,  SIDAC  objectives  include: 

1.  facilitating  the  exchange  of  information  between 
AFLC  and  AFSC  communities, 

2.  promoting  awareness  and  use  of  effective  analysis 
methods  and  techniques. 

3.  eliminating  technical  barriers  which  limit  the 
effectiveness  of  modeling  and  qualitative  analysis 
techniques . 

4.  identifying  and  providing  quality  data  and  informa¬ 
tion  (8:1). 

The  proposed  SIDAC  would  facilitate  these  objectives  by 
providing  the  Air  Force  supportabi 1 i ty  community  with  a  var¬ 
iety  of  'value-added'  technical  services  that  would  assist,  a 
wide  range  of  Air  Force  analysts  and  managers  in  their 
supportabi 1 ity  investment  decision  making  efforts.  These 
services  would  include  providing  assistance  with  analysis 
methods:  identifying,  cataloging,  evaluating,  and  providing 
technical  support  for  a  wide  variety  of  logistics  support 
models;  providing  SIDAC  customers  with  methods  to  improve 
logistics  support  data  collection  efforts:  providing  the 
supportabi 1 l ty  community  with  a  host  of  'corporate'  com¬ 
munication  services;  establishing  a  technical  repository  for 
supportabi 1 i ty  "models,  methods,  and  data  access 


techniques";  and  finally,  undertake  special  studies  and 
tasks  requested  by  members  of  the  user  community  (9:2-3) . 

The  SIDAC  concept  is  timely;  establishing  a  central 
clearing  house  for  the  complex  maze  of  existing  logistics 
support  analysis  methodologies  and  models  would  signifi¬ 
cantly  reduce  the  amount  of  time  spent  by  analysts  in 
searching  for  appropriate  methods  and  models  needed  for 
conducting  logistics  supportabi 1 ity  analyses.  Additionally, 
as  many  logistics  support  analysts  and  managers  do  not  have 
an  extensive  background  in  operations  research  or  other 
sophisticated  analysis  techniques,  the  successful  implemen¬ 
tation  of  the  SIDAC  would  greatly  enhance  the  credibility  of 
the  entire  supportabi 1 ity  decision  making  process.  A  SIDAC 
program  manager  echoed  this  point  recently  by  saying.  "One 
of  the  long  term  goals  of  the  SIDAC  should  be  to  provide  the 
same  credibility  to  logistics  methodologies  and  models  that 
currently  exists  in  the  operational  community"  (41). 
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III.  Me  thodo 1 oqy 

Introduct ion 

This  chapter  provides  the  strategies  and  techniques 
used  to  answer  the  research  question  proposed  in  Chapter  1. 
This  inc ludes : 

1.  the  phases  of  the  research  process; 

2.  the  method  of  PRAM  proposal  selection; 

3.  the  means  of  determining  the  level  of  management 
analysis  and  amount  of  data  required  for  adequate  analysis 
of  each  proposal; 

4.  the  method  of  matching  analysis  requirements  with 
appropriate  logistics  supp  <rt  models,  and  finally; 

5.  how  logistics  support  models  were  used  for  data 
analysis . 

Phases  of  the  Research  Process 

This  research  began  witn  an  literature  review  which 
investigated  technology  insertion,  the  PRAM  Program  office 
and  its  process,  reviewed  literature  discussing  research 
conducted  using  microcomputer-based  logistics  support 
models,  and  detailed  recent  AFLC/AFSC  efforts  to  assist  the 
logistics  support  community  by  exploring  the  feasibility  of 
SIDAC.  Based  upon  a  review  of  current  literature,  a  pilot 
study  was  developed  to  examine  the  application  of  a  tailors 
methodology  for  using  microcomputer-based  logistics  support 
models.  As  such  a  large  portion  of  the  research  methodolog 
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was  exploratory  in  nature.  The  population  of  concern  in 
this  study  was  narrowly  defined  to  recently  active  PRAM 
Program  Office  projects.  Three  projects  were  chosen  for 
analysis  during  the  project  selection  phase  of  the  study. 

The  projects  were  chosen  on  the  basis  of  the  management 
decision  required,  and  how  well  the  project  represented  the 
range  of  typical  PRAM  projects.  More  will  be  said  about 
this  topic  later. 

After  project  selection,  exploratory  analysis  was  con¬ 
ducted  to  determine  the  nature  of  the  management  decision 
required  for  each  project.  During  this  phase  a  preliminary 
assessment  was  also  made  to  determine  the  amount  of  data 
available  for  an  analysis  of  each  project. 

The  next  phase  of  the  research  involved  an  initial 
survey  of  logistics  support  models  to  determine  what  models 
had  the  capabilities  to  accomplish  the  analyses  required  by 
each  project . 

After  this  initial  model  survey  was  conducted,  addi¬ 
tional  data  was  gathered  on  each  project.  This  step  was 
necessary  i  muse  the  existing  data  on  all  projects  was 
insufficient  to  drive  even  the  most  basic  model  considered 
for  use.  The  models  under  consideration  for  use  were  all 
examined  for  common  data  elements  needed,  after  which  a  data 
sheet  was  formulated  to  gather  most  of  the  additional  data 
required  to  drive  the  models  (See  Appendix  A! . 
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The  final  model  selection  process  occurred  only  after 
this  extensive  data  gathering  effort  was  completed  for  each 


project.  It  was  during  this  phase  that  each  project  was 
matched  with  a  microcomputer-based  computer  logistics  sup¬ 
port  model  for  guantitative  analysis  consistent  with  the 
level  of  management  decision  reguired. 

The  final  phase  of  the  research  included  the  quantita¬ 
tive  analysis  of  each  selected  PRAM  project  proposal  and  th 
report  of  the  findings.  This  included  a  report  of  the 
quantitative  improvements  (or  decreases)  in  the  measures  or 
merits  reported,  how  the  quantitative  analysis  of  each 
proposal  affected  overall  analysis,  any  limitations  of  the 
models  used,  and  finally  conclusion^  and  recommendations  fo 
follow  on  research. 

PRAM  Proposal  Selection 

The  projects  chosen  for  research  were  selected  by  the 
PRAM  Program  Manager/Division  Chief.  Lt  Col  Charles 
Ferguson,  and  the  deputy  PRAM  Program  Manager/Division 
Chief,  Mr.  John  Tirpack.  Lt  Col  Ferguson  and  Mr.  Tirpack 
selected  these  projects  based  on  qualitative  criteria.  The 
criteria  used  to  select  each  proposal  were : 

I.  How  well  the  type  of  project  represented  the  range 
of  typical  PRAM  projects. 


59 


2.  The  degree  of  qualitative  uncertainty  generated  by 
each  proposa 1 . 

3.  The  overall  cost  of  each  project. 

The  decision  criteria  is  highly  qualitative  and  may  be 
subject  to  the  bias  of  the  PRAM  Program  Director  and  Deputy 
Director.  However,  both  men  had  the  highest  level  of  broad- 
based  PRAM  project  management,  and  were  the  best  qualified 
personnel  within  the  PRAM  Program  Office  to  perform  project 
se 1 ect ion . 

Determining  the  Level  of  Analysis  Required 

The  level  of  analysis  required  was  a  function  of  two 
elements.  First  the  support abi 1 i ty  assessment  decision 
desired  for  each  project  was  determined  through  an  analysis 
of  each  PRAM  project  plan  and  interviews  with  each  PRAM 
project  manager.  Additionally,  senior  PRAM  managers  were 
interviewed  to  further  determine  the  exact  nature  of  the 
supportabi 1 i ty  assessment  information  desired  tor  final 
project  approval. 

After  the  nature  of  the  logistics  support  decision  re 
quired  by  management  was  ascertained,  each  project  was  re¬ 
viewed  to  determine  the  amount  and  exact  nature  of  data 
available  to  perform  a  quantitative  analysis  on  each 
project.  Information  regarding  data  availability  was 
gathered  through  a  review  of  each  project  proposal, 
exploratory  interviews  with  PRAM  project  managers,  and 


exploratory  interviews  with  other  AFLC/AF5C  logistics  per-- 
sonne  1  . 

Initial  Microcomputei — based  Logistics  Model  Survey 

After  the  exact  nature  of  the  supportab i 1 i ty  decision 
and  amount  of  quantitative  data  available  were  determined 
for  each  proposal,  a  matrix  was  used  to  place  each  project 
into  one  of  three  categories  of  analysis.  The  three 
categories  represented  a  continuum  of  quantitative  analysis, 
progressing  from  preliminary  analysis  to  very  detailed 
analysis,  with  proposals  that  needed  a  moderate  amount  or 
analysis  being  placed  in  the  second  category. 

Once  each  project  was  classified,  an  in-depth  search 
was  made  to  select  several  microcomputer-based  logistics 
support  models  that  might  be  appropriate  for  use  with  the 
various  proposals.  These  models  were  identified  by  a  var¬ 
iety  of  means.  The  model  catalog  under  development  by  the 
SIDAC  concept  exploration  team  wa^  the  main  source  of  can¬ 
didate  model  identification.  After  potential  models  were 
identified,  the  various  offices  ot  primary  responsibi l ity 
were  contacted  in  order  to  obtain  the  appropriate  software 
and  documentation.  Finally,  once  the  models  were  obtained, 
their  analytical  capabilities  were  ascertained  and  their 
data  inputs  were  examined. 


b  1 


Additional  Data  Collection  Efforts 


After  an  examination  of  the  data  inputs  required  for 
all  candidate  logistics  support  models,  it  became  quite 
evident  that  a  considerable  amount  of  additional  data  had  to 
be  gathered  to  drive  any  of  the  models  being  considered. 
After  examining  the  data  input  requirements  of  all  candidate 
models,  a  standard  data  collection  form  was  devised  in  order 
to  facilitate  these  additional  data  collection  efforts.  A 
draft  copy  of  the  SIDAC  data  catalog  was  then  consulted  to 
locate  Air  Force  data  systems  that  contained  these  required 
data  elements.  Various  data  experts  at  the  PRAM  office  and 
the  Air  Force  Institute  of  Technology  (AFIT)  were  also 
consulted  during  the  additional  data  collection  effort. 

Final  Model  Selection 

Only  after  these  data  element  forms  were  completed,  and 
several  standard  cost  elements  were  gathered,  did  final 
model  selection  occur.  Criteria  for  final  model  selection 
were  as  foil ows : 

1.  depth/breath  of  analysis  required; 

2.  compatibility  of  data  with  model. 

3.  validity  of  model; 

4.  sensitivity  analysis  capability,  and. 

5.  overall  ease  of  use. 

Each  project  was  evaluated  using  only  one  model.  The 
final  model  selection  decision  was  made  by  the  researcher 
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after  consultation  with  modeling  experts  from  AFLC .  AFSC  and 
the  SIDAC  concept  exploration  team  at  AFLC/LOC  and  Dynamics 


Research  Corporation. 

PRAM  Project  Proposal  Analysis  Using  Selected  Models 

Once  all  the  initial  data  had  been  analyzed  and  a  model 
selected  for  each  proposal,  the  models  were  used  for  per¬ 
forming  the  quantitative  analysis  of  each  proposal.  The 
results  of  the  quantitative  analysis  are  reported  in  the 
findings  section.  These  findings  include  results  of  initial 
computer  analysis,  comments  on  the  ease  of  performing  sen¬ 
sitivity  analyses,  and  the  limitations  on  tie  use  of  these 
computerized  quantitative  techniques. 


Senior  PRAM  management  selected  the  following  three 


projects  for  use  in  this  study: 

1.  The  F-15C/D  Main  Landing  Gear  Wheel  Improvement 
project . 

2.  The  C-141A/B  Variable  Speed  Constant  Frequency 
Electrical  Generating  System  project. 

3.  The  improved  power  supply  project  for  the 
AN/ALR-46/69  Signal  Processor. 

All  projects  had  been  evaluated  by  the  PRAM  staff  n  an  ini¬ 
tial  PRAM  Project  Plan.  Included  in  each  of  these  plans  was 
a  specific  recommendation  by  various  members  of  the  PRAM 
staff  for  approval  or  disapproval  of  each  project.  For 
reasons  explained  below.  PRAM  management  was  interested  in 
how  quantitative  analysis  using  microcomputer  logistics 
support  models  would  collaborate  or  refute  the  staff  recom 
mendat ions. 

Description  of  Selected  Projects 

F-15C/D  Main  Landing  Gear  Wheel  Improvement . 

Although  ^he  current  aluminum  alloy  wheel  (referred  to 
hereafter  as  the  2014  wheel)  on  the  F-15C/D  main  landing 
gear  performs  adequately  and  the  wheel  lasts  about  1U  yeais. 
this  project  was  the  result  of  an  unsolicited  proposal 
submitted  to  the  PRAM  office  in  December  1900.  by  the  Dendix 


Brake  division  of  Allied  Signal  Corporation.  This  proposal 
suggested  that  by  purchasing  a  superior  aluminum  alloy  wheel 
made  by  Allied  Signal  in  future  procurement,  the  Air  Force 
would  realize  substantial  operational  and  support  cost 
savings  through  reductions  in  depot  overhauls  of  the  wheels 
(13:1). 

What  allegedly  makes  the  Allied  Signal  wheel  superior 
to  the  existing  wheel  is  the  use  of  a  rapid  solidification 
technology  (RST)  process  along  with  powder  metal  technology. 
According  to  the  proposal  submitted  by  Allied  Signal,  the 
RST  wheel  will  have  nine  times  the  corrosion  resistance, 
three  times  the  high  temperature  strength,  and  last  50 
percent  longer  than  the  existing  wheel  (13:1). 

PRAM  management  selected  the  improved  F-15C/D  aircraft 
wheel  project  for  inclusion  in  the  study  because  they  felt, 
it  was  represer tat l ve  of  a  typical  PRAM  project.  Addition¬ 
ally.  PRAM  management  expressed  an  interest  m  more  accut  - 
ately  quantifying  any  economic  cost  savings  generated  by 
this  project.  Another  consideration  was  the  large  expendi¬ 
ture  of  PRAM  project  development  costs  tor  this  project 
(over  $800,000  dollars'  (17). 

C-141A/B  Variable  Speed  Constant  Frequency _ (  V3CF ) 

System .  This  project  resulted  from  an  initiative  undertaken 
by  Military  Airlift  Command's  Office  of  Logistics  Roliabii 
ity  and  Maintainability  (MAC/LGR)  in  1907.  They  were  inter¬ 
ested  in  evaluating  the  feasibility  of  replacing  the  man 


power  intensive  constant,  speed  drive  electrical  generating 
system  on  the  C14iA/B  with  a  variable  speed,  constant  fre¬ 
quency  system  (12:1). 

Although  this  particular  Candidate  Project  had  been 
recently  disapproved  for  further  continuation  as  a  active 
PRAM  project,  PRAM  management  was  interested  in  determining 
if  and  how  quantitative  analysis,  using  microcomputer  logis¬ 
tics  modeling,  would  support  the  findings  of  the  PRAM  staff. 
Another  factor  which  drove  the  selection  of  this  project  for 
the  study  was  the  high  degree  of  controversy  surrounding  the 
use  of  the  constant  speed  drive  electrical  generating  system 
versus  the  variable  speed  constant  frequency  system.  An 
additional  reason  for  inclusion  of  this  project  in  the  study 
was  the  high  PRAM  development  costs  as  well  as  Air  Force 
C-141  fleet  implementation  costs.  The  cost  of  the  PRAM 
development  project  was  to  be  $4  million  dollars,  with  the 
implementation  costs  to  the  Air  Force  of  at  least  3107 
million  doll ars . 

AN/ALR-46/69  Signal  Processor  Power  Supply 
Improvement .  The  AN/ALR-46/69  Radar  Warning  Receiver  \ RWR ' 
is  used  by  many  weapon  systems  throughout  the  Air  Force  as 
an  intricate  part  of  their  overall  electromagnetic  counter¬ 
measures  (ECM)  system.  Within  the  RWR.  the  signal  processor 
unit  plays  a  critical  role  in  detecting  hostile  radar  sig¬ 
nals.  It  is  crucial,  therefore ,  for  the  signal  processor  to 


work  correctly  when  required. 


However,  many  problems  exist  with  the  current  Signal 
Processor  Power  Supply.  The  existing  power  supply  design 
has  inefficiencies  which  contribute  to  overheating  problems. 
Additionally,  demands  on  the  existing  power  supply  can 
escalate  to  a  point  that  the  electrical  output  of  the  power 
supply  becomes  unsatisfactory.  As  a  result,  the  Systems 
Engineering  Branch  at  Warner-Robbi ns  Air  Logistics  Center 
proposed  to  improve  the  AN/ ALP.  46/69  Signal  Processor  Power 
Supply  through  redesign  (10:2,3). 

Senior  PRAM  management  saw  this  as  an  ideal  project  t o 
include  in  this  study.  Since  the  project  was  a  proposal  for 
a  form,  fit,  and  function  improvement  of  a  component  across 
several  different  weapon  systems,  each  with  its  unique 
characteristics,  they  felt  that  any  analysis  of  economic 
costs  and  benefits  wouiu  prove  difficult  Senior  PHAM 
management  was.  therefore,  very  interested  in  how  support 
ability  analysis  using  a  microcomputer  based  log ist  ics 
suoport  model  would  meet  this  challenge.  Additionally, 
during  the  course  of  this  study,  the  project-  d-'Ve  1  /rmeri? 


analysis  that  each  project  required.  This  was  accomplished 
in  three  steps.  First  both  senior  PRAM  management  and  each 
project  manager  were  interviewed  in  an  effort  to  determine 
the  exact  nature  of  the  supportabi 1 1 ty  decision  desired  for 
each  project.  Next.  each  PRAM  Project  Plan  was  carefully 
examined,  with  all  appropriate  quantitative  data  extracted 
for  later  use.  Finally,  the  PRAM  manager  of  each  project 
was  interviewed  to  fill  in  as  many  'gaps'  in  the  data  as 
pass i b 1 e . 

F-15C/D  Improved  Whce  1  .  The  decision  orientation  f  la¬ 
the  F-15'YD  improved  wheel  was  directed  toward  life  cycle 
costs  ( LCC ) .  This  was  based  on  the  fact  that  the  initial 


unit  cost  of  the  proposed  wheel  was  over  $1000  dollars 
higher  than  the  unit  cost  of  the  existing  wheel.  Since  the 
existing  wheel  provided  adequate  reliability,  m  order  tor 
this  project  to  be  considered  a  success,  any  analysis  neode 
to  demonstrate  reductions  in  operating  and  support  costs 
over  the  useful  life  of  the  F-lbC/D  aircraft  ! 47 ) . 


PRAM 

Pr 

o  j  e  c  t 

P lan  r  eve  a  led  o  n 1 y  a 

very  br^T 

ana  1  y 

S  1 

s  .  As 

outlined  m  Table  1. 

the  F-lYTT 

Improved  Wheel  Project  Plan  disclosed  all  the  major  element 
of  PRAM  developin'  nt  costs,  and  only  ten  data  elements  tor 
each  alternative's  operational  and  support  costs.  Fur  trier 


ana  lysis  showed  t  lat  almost  all  of  t  he  data  listed  in  the 
project  plan  came  exclusively  from  r  he  contractor  pi  o  sal 


Table  i 


Original  Data  Available  for 
F-15C/D  Improved  Wheel 

A.  PRAM  Program  Cost 


Activity 

Cost 

Wheel  Material 

$450 ,700 

Forging  Processing 

$  131 . 600 

Wheel  Mdc’nini ng 

$50 . 600 

Material  Characterization 

$66 . 500 

Brake  Material 

$57 . 500 

Data  Analysis 

$87 , 500 

Total  PRAM  Project  Cost 

$846 , 500 

B.  Comparison  of  20  Year 

ULS*  -  2014  vs  RST 

A  I  1  ov 

2014 

RST 

1' "J  Ci  V  1  n  '7  3 

Wheel  Cost  per  Unit 

$6000 

$78u0 

($1800 

Wheel  Life,  Years 

i  2 

18 

Wheel  Cost  per  Year 

$  5  00 

$  433 

Overhaul  Cost  per  Whe*=  i 

$  1  5  0  U 

$1000 

Overhaul  Cycle  in  Years 

4 

Overhaul  Cost  per  Year 

■r  '?  5  Q 

$  2  5  0 

Total  Wheel  Cost  per  Year 

$1250 

$  683 

$  5r 

Annualized  Cost  of  Fleet 

$  I i750Q0 

$642333 

$5  3266 

20  Year  Cost  of  Fleet  $ 

2  250 U 000 

$  1  2346 66  7 

$  1 0  6 .5  3 .  •'  3 

Savings 

Per  Year 

$5 : 

•  2  6  6 

R  e  t  u  r :  i  o  n  I  n  v  e  s  t  rne  n  t  o  v  e  r 

2u  years 

*  Useful  L i f e  Sav 1 ngs 


C-141A/B  V a r i a b le  Speed  Constant  Frequency  (VSCF) 
System .  The  decision  orientation  for  the  VSCF  project  had 
two  dimensions.  The  major  variables  to  be  evaluated  in  thi 
project  were  reliability  and  life  cycle  costs.  Specifical¬ 
ly,  PRAM  management  wished  to  determine  if  the  proposed 
improvements  in  reliability  and  reduction  in  operating  and 
support  costs  of  the  VSCF  system  would  outweigh  the  large 
project  development  and  life  cycle  costs. 

The  C-141A/B  VSCF  System  Project  Plan  indicated  that  a 
large  amount  of  data  had  previously  been  collected  for  this 
study.  Data  outlined  in  this  plan  came  from  several  dif¬ 
ferent  sources;  from  contractors,  various  Air  Logistics 
Centers.  Military  Airlift  Command,  and  numerous  AFLC  ar.d  AS 
agencies  located  on  Wright  Patterson  Air  Force  Base  <  1 4  :  B  )  . 
Additionally,  an  extensive  amount  of  data  was  obtained  ft  m 
the  Reliability  and  Maintainability  Data  Analysis  System 
( RAMDA5 )  as  well  as  supply  system  and  depot  overhaul  report 
in  a  subsequent  analysis  (36:1).  Table  2  lists  all  data 
available  for  the  C-141A/B  VSCF  protect. 

AN/ ALR --46/69  Signal  Proce s so r  Power  Supp  1  v 

The  decision  orientation  for  the  power  supply  analysis 
consisted  of  three  dimensions.  The  major  variable  /ing 

this  pro  met  were  reliability,  maintainability,  and  life 
cycle  costs.  Specifically.  PRAM  management  sought  to  vie  tor 
mine  exactly  how  proposed  improvements  in  reliability  and 


Table  2 


Original  Data 

Available  for  C- 

141 

VSCF 

Syst 

em 

A.  PRAM  Project  Cost 

Total  Project  Cost 

$4 

.  000 

.  000 

B.  Implementation  Cos 

t 

VSCF  Contractor  Non-recurring 

$3 

.  000 

.  0U0 

VSCF  Contractor  Recur 

r  i  ng 

$107 

.  205 

.  500 

Airframe  Non-recurring 

$1 

.600 

.  ooo 

Airframe  Recurring 

$  1 6 

.  260 

,  000 

Total  Implementation 

Cost 

$132 

.  065 

.  5  0  0 

C.  Comparison  of  CSD 

vers 

us 

VSCF 

cost 

3 

CSD 

VSCF 

Id_ 

ivmas 

Annual  Depot  Repair 

$2  . 

755 

.424 

$ 

300  . 

.  000 

25  Year  Depot  Repair 

$68  . 

885 

.  600 

$7. 

500 

.  000 

$61  , 

385 

6  0  0 

Annual  Base  Repair 

$ 

391 

.  680 

$ 

64  , 

.  000 

25  Year  Base  Repair 

$  9  . 

792 

.  000 

$1  . 

600  , 

.  000 

$  y. 

i  9  2  . 

0  0  0 

Total  Useful  Life  Sav 

l  ngs 

$69 . 1 

577  . 

600 

Return  on  Investment 

0 

.51 

D.  Other  Relevant  Information 

Number  of  C-141A/B  Aircraft 
Number  of  CSDs  Installed 
Number  of  Spare  CSDs 
CSD  Unit  Cost 

VSCF  Unit  Cost  (Estimated) 

CCD  Unit  Repair  Cost 

VSCF  Unit  Repair  Cost  (Estimated) 

CSD  Mean  Time  Between  Failure 

VSCF  Mean  Time  Between  Failure  ( Est 

Annual  CSD  Depot  Repairs 

Annual  Generator  Repairs 

Genei  ator  Unit  Repair  Cost. 

Annual  VSCF  Depot  Repairs  (Est) 


Amount 
271 
1084 
q  2  3 

$60. 133.76 
$74.500. 00 
$3.702. 32 
$3 . 000 .00 
1.595  hrs 
4.000  hrs 
612 
316 

$  1.550. 00 
100 
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Table 


Original  Data  Available  on 
AN/ALR-46/69  Signal  Processor  Power  Supply 


A.  PRAM  Project  Cost 

Redesign  Power  Supply 
Fabricating  and  Demonstrat i ng 
Operational  Testing  and  Eva luat i^n ■ OT&E) 
OT&E  Level  Three  Drawing 
Total  PRAM  Project  Cost 


Cost 
$60 . 000 
$120 . 000 
$  40.000 
$  80.000 
$300 . 000 


B.  Implementation  Cost 


None 


C.  Cost  Comparison  and  Other  Relevant  Data 

Current  Proposed 


Mean  Time  Between 
Failure  ( MTBF ) 

Fower  Supply  Unit  Cost 
Required  Spares* 

Yearly  Depot  Repair  Cost 
Yearly  Depot  Repairs 
10  year  Repair  Cost  $ 

Depot  Repair  Manhours 
per  Unit 

Estimated  10  Year 
Manhour  Repair  Costs**  $ 


1950  hrs  10.000  hrs 


$4 . 160 
446 
$578 
55 . 2 
324 . 024 

11  hrs 

281 , 255 


$3 . 000 
87 
$70 

10 . 8 ( est ) 
$7 . 560 

1 . 3  hrs 

$6,503 


bavi  nc 


$1 .493.440 

$  3 1 6 , 464 

$  274.751 


Total  Useful  Life  Savings  $2,084,655 

Return  on  Investment  6.95 


*  Estimate  of  Total  Spares  Required  over  10  year  period 
**  Calculated  by  multiplying  number  of  repair'-  required 
over  ten  year  period  by  depot  manhours  required  per 
repair  and  cost  per  depot  manhour  (DMH) .  DMH  cost 
used  was  $46 . 32 


maintainability  of  the  redesigned  Signal  Processor  Power 
Supply  would  reduce  its  operations  and  support  costs. 

A  moderate  amount  of  data  existed  for  an  economic 
analysis  of  the  power  supply.  Table  3  lists  the  originu 
data  available  from  the  PRAM  Pro  lect  Plan. 


Categories  of  Analysis 


Based  on  the  decision  or lentat ion ( s )  of  each  project 
and  the  amount  of  data  available  for  analysis,  each  project 
was  classified  into  a  distinct  analysis  category.  These 
analysis  categories  represented  a  continuum  of  complexity, 
ranging  from  relatively  uncomplicated  analysis  to  studies 
which  necessitated  a  high  degree  of  analysis  to  accurately 
capture  all  essential  elements  required  to  make  an  informed 
decision.  The  projects  were  placed  into  these  distinct 
categories  of  analysis  in  order  to  facilitate  the  search  fir 
the  appropriate  logistical  support  model.  Table  4  reflects 
the  category  of  analysis  required  for  each  project. 

Table  4 

Categories  of  Analysis  tor  PRAM  projects 
Analysis  Ca tegory 

Relatively  Moderately  More 

Simple  Complex  Complex 

PRAM  Project 

F-15C/D  Improved  X 

Aircraft  Wh e e 1 

C-141A/B  VSCF  X 

System 

AN/ALR-46/69  X 

Signal  Processor 
Power  Supply 


Rat i ona 1 .  The  F-15C/D  Improved  Aircraft  Wheel 
project  was  placed  into  the  relatively  simple  category 
because  of  the  one  dimensional  nature  of  the  decision  orien¬ 
tation.  as  well  as  the  limited  amount  of  data  available  to 
perform  the  analysis.  The  decision  orientation  of  the 
project  was  aimed  solely  at  life  cycle  costs  and  only  about 
30  data  elements  were  initially  available  for  analysis. 

The  C-141  VSCF  System  analysis  was  placed  Into  the 
moderately  complex  category  because  of  the  two  dimensional 
nature  of  the  decision  orientation.  PRAM  management  was 
interested  in  determining  exactly  how  reliability  improve¬ 
ments  affected  life  cycle  costs.  Additionally,  a  fairly 
large  amount  of  data  was  available  for  conducting  the  anal¬ 
ysis. 

It  was  hard  to  determine  exactly  where  the  AN/ ALR- 46 /6'j 
Signal  Processor  Power  Supply  project  fit  on  the  continuum 
of  required  analysis.  While  the  three  dimensions  of  reliab¬ 
ility.  maintainability,  and  life  cycle  costs  tended  to  shift 
the  required  analysis  all  the  way  to  the  right,  the  incom¬ 
plete  nature  of  the  initial  data  listed  in  the  PRAM  Pro.  ject 
Plan  made  any  complex  analysis  of  this  project  difficult. 

Initial  Model  Survey 

After  identifying  the  decision  or lentat ion ( s )  and  the 
amount  of  data  available  for  each  project,  an  informal 
survey  of  support abi 1 l ty  models  was  made  in  an  effort  to 
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determine  which  models  could  possibly  be  used  tor  project 
analysis.  The  initial  starting  point  for  the  survey  was  the 
SIDAC  model  catalog.  Additionally,  informal  discussions 
were  conducted  with  members  of  the  AFIT  faculty  and  various 
AFLC  and  AF5C  agencies. 

The  candidate  models  were  initially  selected  based  on 
their  ability  to  run  on  a  microcomputer,  and  their  ability 
to  measure  one  or  more  of  the  decision  variables  for  any 
selected  project.  Based  cn  these  initial  criteria,  several 
microcomputer  supportabi 1 lty  models  were  identified  as 
candidates  for  use  in  performing  analyses.  Candidate  models 
i nc 1 uded : 

1.  Statistically  Improved  Life  Cycle  Cost  (5ILCC, . 

This  model  includes  the  capability  to  perform  component  life 
cycle  cost  analysis  based  on  only  a  limited  amount  of  data 
(37:11) . 

2.  The  Logistics  Analysis  Methodology  Program  using 
the  Logistics  Analysis  Work  Station  (LAMP/LAWS).  This  mode- 1 
includes  the  capability  to  measure  a  project's  performance 
in  terms  of  combat  capability,  survivability,  manpower, 
mobility,  and  life  cycle  costs.  This  model  can  be  used  to 
measure  how  reliability  or  maintainability  improvements 
affected  not  only  life  cycle  costs,  but  other  RLM  measures 
of  merit  as  well  (28:2-1). 

3.  Logistics  Support  Costs  ( LSC ) .  This  mode l  inc ludes 
the  capability  to  estimate  costs  of  new  weapon  system  ero 


7b 


curement  and  weapon  system  modifications.  It  also  has  the 
capability  to  determine  the  impact  of  design  changes  on  a 
wide  variety  of  life  cycle  costs  (11:1). 

4.  Cost  Analysis  and  Strategy  Assessment  (CASA).  CASA 
is  a  group  of  Logistics  and  Life  Cycle  Costs  models 
integrated  through  the  use  of  option  menus.  CASA  includes 
the  capability  to  perform  several  supportabi 1 1 ty  analysis 
tasks  relevant  to  the  three  projects  in  this  study, 

inc luding : 

*  LCC  Estimates 

*  Trade-off  Analysis 

*  Risk  and  Uncertainty  Analysis 

*  Cost  Driver  Sensitivity  Analysis 

*  Reliability  Growth  Analysis 

*  Spares  Optimization  (7:1-1). 

5.  System  Cost  Operational  Performance  Evaluation  for 
Modification  (SCOPE-MOD) .  SCOPE-MOD  incorporated  the  cap¬ 
ability  to  assess  how  proposed  changes  in  weapon  system 
reliability  and  maintainability  would  affect  the  entire 
spectrum  of  R&M  2000  goals  for  that  particular  weapon  sys¬ 
tem.  It  performs  this  analysis  by  comparing  a  'complete' 
baseline  data  set  for  a  particular  weapon  system  with  a  data 
set  including  the  proposed  modification  parameters.  The 
output  of  the  SCOPE-MOD  models  is  designed  to  highlight  the 
differences  of  the  proposed  modification  and  the  current 
system  l"  terms  of  both  life  cycle  costs  and  various 
operational  parameters,  such  as  number  of  sorties  generated. 
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number  of  targets  destroyed,  and  aircraft  availability 
(39 :2-b) . 

6.  Life  Cycle  Cost  Analysis  Program,  version  H  for  per 
sonal  computers  (LCCHPC).  The  LCCHPC  model  evaluated  for 
this  study  was  a  microcomputer  adaptation  of  the  LCC-2  Lire 
Cycle  Cost  Analysis  Program.  LCCHPC  included  the  capabi 1 : f 
to  "evaluate  the  costs  of  acquiring  an  avionics  system  and 
supporting  it  over  its  operational  life"  (19:1-1).  The 
model  also  incorporates  the  ability  perform  comparative 
analysis  of  different  support  concepts,  explore  sens  it  lvr.y 
of  life  cycle  costs  to  several  different  critical  parameter 
(such  as  turnaround  times,  mean  time  between  failure  1MTBF] 
demand  rates,  etc.),  determine  required  spares  levels,  and 
identify  important  cost  driving  parameters  t iv ; 1  - 1 ;  . 

Additional  Data  Collection  Effort;?. 

From  the  initial  survey  of  microcomputer  legist.  :  re¬ 
models  available  for  performing  PRAM  project  support ab l 1 : t y 
analysis,  it  became  evident  that  the  data  used  for  qroorn 
plishing  previous  studies  was  not  :;oina  to  or- -vide  enough 
detail  to  allow  the  use  of  even  the  most  basic  logistics 
support  model.  In  order  to  use  any  of  the  candidate  mo-dels 
it  was  clear  that  much  more  additional  data  would  have  to  h 
col  1 e  c  t  e  d . 

In  order  to  facilitate  this  additional  data  collection 


effort,  a  firm  was  designed  to  facilitate  data 
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Several  models  were  examined  for  common  input  elements  and 
standard  data  collection  format  was  designed  to  assist  m 
gathering  additional  data.  This  standard  data  collection 
format  and  the  additional  data  collected  for  each  project 
are  included  in  Appendices  A  through  D. 

The  amount  of  additional  data  required  was  a  function 
of  several  factors.  These  included  the  amount  of  data  in¬ 
cluded  in  the  PRAM  Project  Plan,  the  nature  of  the  decision 
or i entat 1  on ( s )  .  and  the  number  of  weapon  systems  affected  b 
the  project.  Additionally,  although  the  final  selection  of 
the  logistics  support  model  used  was  ultimately  a  factor  in 
deciding  what  additional  data  had  to  be  collected,  the 
collection  of  the  comm  on  data  elements  listed  on  the  form 
shown  in  Appendix  A  minimized  the  need  to  collect  add  1 1 ionu 
data  elements  once  the  final  models  had  been  selected. 

This  additional  data  collect,  ion  effort  proved  to  be  a 
challenging  task.  As  almost,  all  of  the  previous  analysis 
done  m  the  PRAM  Program  Office  was  qua.  .ative  in  nature . 
only  one  program  manager  within  the  PRAM  office  was  familia 
with  current-  Air  Force  logistics  support  data  systems .  F  t 
turiately.  the  data  catalog  under  development  by  the  S I  PA  o' 
concept  exploration  team  provided  much  needed  assistance  in 
the  hunt  for  additional  data.  While  this  document  was  not 
completed  during  the  data  collection  efforts  <.  t  this  on-  su¬ 
it  did  provide  important  clues  about  what  Air  F.-.roe  data 
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systems  to  use  to  obtain  support  data  as  well  as  the  infor 
mation  each  data  system  contained. 

The  two  Air  Force  data  systems  used  to  collect  addi¬ 
tional  information  regarding  critical  data  elements  were  t 
various  maintenance  and  operational  data  gathered  by  the 
D056  Maintenance  Data  Collection  System  and  complied  by  th 
Maintenance  and  Operational  Data  Access  System  fMODAS)  as 
well  as  various  forms  of  the  D041  supply  data  system.  In 
order  to  ensure  the  information  gathered  from  the  "arious 
Air  Force  data  systems  was  accurate,  the  data  was  compared 
with  data  compiled  by  the  Air  Logistics  Center  ( ALC )  Item 
Management  Office  for  the  item  evaluated  in  each  project. 
It  was  during  this  phase  of  research  that  major  discrepan 
cies  were  noted  from  data  gathered  from  the  Air  Force  data 
systems  used  and  the  information  reported  by  the  various 
item  managers. 

This  problem  was  especially  difficult  when  gathering 
additional  data  for  the  F-15C/D  Improved  Aircraft  Wheel  Pr¬ 
iest  .  This  difficulty  first  came  to  light  when  attempting 
to  obtain  failure  data  from  MODAS .  Data  extracted  from 
MOD AS  indicated  that  the  current  wheel  was  experiencing  at 
least  two  to  three  failures  per  month,  fleet  wide.  lieweve 
a  check  of  the  D04i  supply  system  report  showed  that  the 
wheei  mean  time  between  demand  ( MTBD )  was  only  one  wheel 
every  56  months.  To  further  contuse  the  issue,  the  Deputy 
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Item  Manager  on  this  wheel  was  carrying  a  MTBD  of  9.3.71 
months  ( 35 )  . 

Unfortunately,  inaccurate  data  was  not  limited  just  t 
the  use  of  MODAS  data.  Further  research  indicated  that  di 
crepancies  existed  in  all  data  systems  use...  including 
systems  to  gather  such  basic  information  as  number  of  air 
craft  available  in  the  active  Air  Force  inventory  (6) . 

This  potential  tor  inaccurate  data  was  cause  for 
major  concern.  Unfortunately,  there  was  no  easy  solution 
the  data  accuracy  problem.  Two  major  steps  were  taken  no 
mitigate  the  consequences  of  inaccurate  or  unreliable  auta 
First,  data  was  verified  for  accuracy  wU.h  the  respective 
item  managers  or  equipment  specialists  in  as  much  as  this 
was  possible.  Where  the  data  systems  conflicted  with  mro 
mat  ion  received  from  the  item  managers,  the  data  from  the 
item  manager  was  assumed  to  be  more  current  and  also  mo*'*3 
accurate.  Second .  the  problem  of  inaccurate  data  dictated 
the  importance  of  using  a  model  that  featured  strong  sen¬ 
sitivity  analysis  capability. 

Gathering  additional  data  hr  the  AN/AuR  -4o/  ov  .'rnioi 
Processor  Power  Supply  project  proved  to  be  the  moot  on.:.  1 
lenging  task  of  this  entire  study.  As  seated  earlier,  thi 
particular  component  exists  m  many  different  weapon  sys 
toms .  all  which  have  r at her  diet  met  mmsmns.  It  would  h 
logical  to  assume,  there  lor  e  .  t.hu  f  the  3  >.•  jri..t  l  pro- >r  .  a 
t  hereby  the  power  sup;  1  y  o  t  <  ■  a ' '  h  we  ip  ai  ~  y..  ?.em  .  ai  *~  sun  n-- 


If  this  is  true,  then  the 


to  different  levels  of  stress, 
failure  and  demand  parameters  for  the  signal  processor  pow«r 
supplies  will  vary  from  weapon  system  to  weapon  system, 
depending  upon  how  each  is  used. 

The  data  gathered  from  MODAS  validates  tl  ese  assump¬ 
tions.  Depending  on  the  particular  weapon  system,  the  mean 
time  between  maintenance  for  the  signal  processors  varied 
from  as  little  as  252  flying  hours  to  over  4000  flying  hours 
(30.)  . 

The  variance  in  the  magnitude  of  reliability  and  main¬ 
tainability  figures  between  weapon  systems  was  only  one- 
symptom  of  a  more  daunting  task.  Of  the  six  candidate 
models  selected  for  possible  use.  none  of  them  were  designed 
for  performing  analyses  on  more  than  one  system  at  a  time. 

Only  two  options  were  available  for  performing  a  sup- 
portability  analysis  of  this  type.  The  first  option  was  to 
perform  a  separate  analysis  on  how  the  power  supply  affected 
each  separate  weapon  system  and  then  aggregate  the  results. 
However,  because  of  the  pre-existing  aggregation  of  supply 
system  data  on  the  Signal  Processor  Power  Supply,  it  was 
determined  that  this  method  of  analysis  would  was  not  prac¬ 
tical.  The  only  other  option  was  to  develop  a  methodology 
for  aggregating  each  weapon  system  reliability  and  main¬ 
tainability  figures  into  a  one  distinct  number  that  woul.i 
represent  a  single  weapon  system. 
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Methodology  Established  for  AN/ALR— 4b/69  Power  Supply 

Data  Aggregation 

Without  the  development  of  a  valid  method  to  aggregate 
R&M  data  Into  a  representative  system,  any  quantitative 
analysis  using  current  microcomputer  logistical  support 
models  would  have  proven  impossible.  Fortunately,  with 
considerable  patience  and  assistance  from  the  AFIT  Center  or 
Excellence  for  Reliability  and  Quality,  a  valid  technique 
was  devised  to  convert  atl  the  distinct  data  into  represen¬ 
tative  aggregates.  The  following  section  details  the  steps 
taken  to  aggregate  this  information: 

1.  The  number  of  annual  flying  hours  was  gathered  for 
each  weapon  system.  These  flying  hours  were  then  totaled 
into  a  single  aggregate  number.  The  number  of  flying  hours 
for  each  weapon  system  was  divided  by  the  total  number  of 
flying  hours  for  all  systems  in  order  to  come  up  with  a 
weighted  flying  hour  contribution  factor  for  each  weapon 
system . 

2.  After  the  flying  hour  contribution  factor  for  each 
weapon  system  had  been  determined,  the  next  step  was  to 
identify  the  appropriate  reliability  and  maintainability 
information  from  MODAS .  This  task  was  rather  challenging 
for  two  reasons.  First,  the  work  unit  codes  for  the  Signal 
Processor  and  Power  Supply  were  different  between  the 
various  weapon  systems.  Fortunately,  within  MODAS  there  are 
work  unit  code  listings  which  allow  you  to  identify  the 
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appropriate  work  unit  code  for  any  component  residing  in  any 
active  Air  Force  weapon  system.  Second,  while  adequate  R&M 
data  existed  for  the  Signal  Processor  work  unit  code,  often 
no  data  was  available  for  the  power  supply  card.  While,  at 
first,  this  appeared  to  make  the  whole  quantitative  analysis 
of  the  Signal  Processor  Power  Supply  infeasible,  a  estima¬ 
tion  of  power  supply  failure  percentages  within  each  weapon 
system  allowed  the  analysis  to  continue.  The  Systems 
Engineering  Branch  at  Warner  Robbins  Air  Logist.es  Center 
estimated  that  six  percent  of  all  Signal  Processor  failures 
were  caused  by  the  power  supply  in  some  weapon  systems 
( F- 1 6 A/B/C/D ;  F-4D ;  AC-130H:  MC-130E;  MH-53H/J:  HC-130N/PI: 
in  other  weapon  systems  they  estimated  this  percentage 
increased  to  eleven  percent  (A-10A:  B-52G;  B-52H:  A  -7D/K: 
AC-130A;  F-4E;  RF-4C )  (10:2).  Once  the  reliability  values 

for  the  various  Signal  Processors  had  been  identified, 
these  estimated  percentages  were  then  used  to  determine  the 
reliability  values  of  the  individual  power  supplies. 

Before  the  estimated  percentages  could  be  used  however, 
three  more  intermediate  steps  had  to  be  taken: 

a.  First  the  appropriate  "time  between"  variable 
(MTBF.  iMTBM )  was  converted  into  a  reliability'  rate  by  using 
the  reciprocal  value. 

b.  Once  the  appropriate  reliability  rate  was  deter¬ 
mined.  this  value  was  multiplied  by  the  flying  hour 
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contribution  factor  in  order  to  determine  the  weighted 
f ai lure  rate . 

3.  This  weighted  failure  rate  was  then  reconverted 
into  a  mean  time  between  figure  once  again  using  the 
reciprocal  value. 

After  the  weighted  time  between  reliability  figure  was 
determined  for  the  Signal  Processor  of  each  affected  weapon 
system,  this  value  was  then  divided  by  the  power  supply 
failin-'3  ner^^r.t  age  *  ~  order  to  estimate  the  ti,,^ 
reliability  value  of  the  Signal  Processor  Power  Supply. 

This  time  between  value  was  once  again  converted  to  a  leli- 
abi 1 lty  rate . 

Once  this  weighted  power  supply  reliability  rate  had 
been  determined  for  each  weapon  system,  these  weighted  rates 
were  then  summed  to  reach  an  overall  weighted  reliability 
rate.  This  overall  reliability  rate  was  then  converted  back 
into  an  overall  mean  time  between  reliability  factor  by  once 
again  using  the  reciprocal  of  the  overall  reliability  rate. 
Table  5  illustrates  this  proc<  for  determining  mean  time 
between  failure  (MTBF). 

Finally,  as  the  System  Engineering  Branch  determined 
that  the  Signal  Processor  was  only  used  between  35  to  45 
percent  of  most  mission  time,  a  factor  of  .4  was  used  to 
determine  the  appropriate  reliability  and  ma i nta i nab i 1 i ty 
values . 
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Table  5 


AN/ALR-46/69  Signal  Processor  Power  Supply 
Mean  Time  Between  Maintenance  (MTBM)  Calculations  using 
Aggregate  Reliability  Data  Methodology 
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different  from  those  reported  by  the  Engineering  Systems 
Branch  at  Warner  Robbins.  However,  it  is  interesting  to 
note  that  the  Mean  Time  between  Maintenance  calculated  using 
this  methodology  came  within  five  percent  of  the  Mean  Time 
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between  Demand  calculated  by  the  D041  supply  system  (5467.13 
hrs  using  the  reliability  rate  methodology  versus  5712.1  hrs 
reported  in  the  D041  factors  analysis  printout).  Both  the 
MTBM  using  MODAS  and  the  MTBD  value  from  the  D041  factors 
analysis  printout  are  calculated  in  the  same  manner. 

The  additional  data  collection  efforts  required  for 
each  project  were  directly  related  to  the  level  of  analysis 
required  for  the  project.  However,  the  amount  of  data 
previously  collected  by  the  various  PRAM  project  managers 
also  heavily  influenced  the  amount  of  additional  data 
required . 

Both  the  F-15C/D  Improved  Aircraft  Wheel  and  the  C-141 
VSCF  System  lequired  about  the  same  amount  of  additional 
data.  Even  though  the  C-141  VSCF  System  required  a  greater 
depth  ofanalysis  than  did  the  F-15C/D  Improved  Aircraft 
Wheel,  the  C-141  VSCF  System  Project  Manager  had  obtained  a 
greater  amount  of  data  than  had  the  F-15C/D  Improved  Air¬ 
craft  Wheel  Project  Manager.  In  both  cases  however,  the 
amount  of  additional  data  required  was  well  over  300  percent 
more  than  the  original  data  available  for  both  projects. 

Because  of  the  unique  nature  of  the  form,  fit.  and 
function  characteristics  of  the  AN/ALR-46/69  Signal  Proces¬ 
sor  Power  Supply  Improvement  project,  the  amount  of  addi¬ 
tional  data  required  to  perform  an  adequate  microcomputer- 
based  supportabi 1 i ty  analysis  amounted  to  an  exponential 
increase  over  the  original  data  available.  The  amount  of 
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time  needed  to  simply  extract  the  reliability  and  maintain¬ 
ability  information  from  MGDA'J  exceeded  two  man-days.  It 
took  another  week  to  devise  a  methodology  that  aggregated 
the  reliability  and  maintainability  of  each  weapon  system 
into  a  representative  data  set.  Without  the  additional  data 
collection  efforts,  however,  the  appropriate  level  of  sup- 
portability  analysis  could  not  have  been  accomplished. 

Final  Model  Selection  Process 

Only  two  of  the  candidate  models  were  selected  tor  pro¬ 
ject  analysis.  But  before  explaining  the  i amonai  for  final 
model  selection,  it  is  important  to  review  the  criteria  for 
model  selection.  Additionally,  rational  for  non  selection 
of  any  particular  model  will  also  be  given.  Be  advised  that 
the  failure  of  any  model  to  be  selected  for  use  does  not 
necessarily  indicate  a  faulty  model,  only  that  it  did  not 
meet  the  criteria  established  for  model  use.  As  outlined  m 
chapter  three,  the  criteria  for  model  selection  were  as 
foil ows : 

1.  depth/ breath  of  analysis  required: 

2.  compatibility  of  data  with  model: 

3.  validity  of  model: 

4.  sensitivity  analysis  capability; 

5.  overall  ease  of  use. 
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Non-Se I ected  Models,  Only  two  of  the  candidate  models 
initially  considered  for  possiole  use  were  ultimately  used 
to  accomplish  the  required  analyses.  The  reasons  why  the 
two  models  were  selected  will  be  addressed  in  the  sections 
that  discuss  the  quantitative  analysis  of  each  project. 

This  section  will  only  address  the  candidate  models  that 
were  not  selected  for  use  and  the  rational  behind  their  non¬ 
selection. 

The  following  models  were  not  selected: 

1.  LAMP/LAWS.  The  LAMP/LAWS  composite  model,  initial¬ 
ly  considered  tor  use  in  this  study,  was  appropriate  only 
for  use  on  tactical  weapon  systems.  The  only  project  in 
this  study  which  was  tactically  oriented  was  the  F-15CYD 
Improved  Aircraft  Wheel  project. 

However,  two  constraining  factors  of  the  project  itself 
eliminated  LAMP/LAWS  from  final  model  use.  The  first,  and 
probably  the  most  critical  factor  which  eliminated  the  use 
of  LAMP/LAWS  was  the  sheer  lack  of  data  available  for  quan¬ 
titative  analysis.  LAMP/LAWS  required  a  considerable  amount 
of  data  input  (08  variables)  in  order  to  produce  any  mean¬ 
ingful  analysis  (45:183).  While  the  extensive  sensitivity 
analysis  available  would  mitigate  this  problem  in  many 
studies,  the  small  amount  of  data  available  for  the  improved 
F-15C/D  Improved  Aircraft  Wheel  could  not  be  overcome  by 
this  sensitivity  analysis  capability.  The  second  reason  why 
LAMP/LAWS  was  not  selected  for  use  was  because  of  the  single 
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dimensional  nature  of  the  decision  orientation.  LAMP /LAWS 
evaluates  alternatives  against  ail  five  ROM  2000  goals. 
While  this  is  ideally  a  desirable  trait  for  all  trade-off 
analysis  studies,  as  in  the  case  of  the  F-13C/D  Improved 
Aircraft  Wheel  project,  there  may  be  certain  times  when 
decision  makers  may  desire  information  regarding  only  one 
particular  R&M  goal.  In  such  a  single  dimensional  study, 
would  not  be  cost  effective  to  collect  all  the  add  it  ior.o  1 
data  required  to  run  such  a  complex  integrated  model  as 
LAMP/ LAWS  when  other  models  exist  that  only  measure-  the 
single  decision  orientation  desired. 

2.  SCOPE -MOD.  Initially,  this  model  was  favor  ah ly  o: 
sidered  for  accomplishing  the  analysis  required  for  the 
C  -141  VSCF  System  project.  However,  after  a  closer  examm 
tion  of  the  model  along  with  two  serious  problems  with 
actual  model  use,  it  was  determined  that  the  SCOPE  - M'.xL 
software  used  by  the  researcher  had  not  matured  enough  f  ja¬ 
pe  r  forming  the  C-141  VSCF  System  analysis. 

The  initial  evaluation  of  SCOPE-MOD  was  accomplished 
using  the  analyst's  guide  which  came  with  the  software. 
After  evaluating  the  user  documentation,  it  was  determined 
that  SCOPE-MOD  offered  some  potential  benefits  which  might 
prove  to  be  advantageous  to  any  analysis.  First.  SCOPE  MO 
already  provided  the  analyst  with  a  baseline  data  sec. 
thereby  eliminating  the  need  for  the  analyst  to  perform  th 
tedious,  and  time  consuming  task.  The  second  potential 


advantage  that  3C0PE-MCD  offered  was  t  he*  potent :  a  1  to  ev  a  1  . 
ate  how  changes  in  reliability,  ma  :  r.t  a  :  na  b  i  1  ;  ry  .  and  supply 
data  affected  over  a  i  !  system  parameters .  not  only  :  r;  terras 
of  peacetime  operating  costs .  but  in  ‘erms  :  f  wart  irr.e  o:  k  : 
generating  capabilities  as  well. 

unfortunately,  these  potent  ia  •  advantages  r  •  r  c.  -1--.  no 
were  greatly  outweighed  by  seme  ser :•  us  problems  w 1 1  h  o  p  •  ; 
at  mg  the  actual  software.  The  first  time  use  of  the 
DYNAMCD  poition  of  the  software  was  a  t r  *  rr.pt  e  1 .  •.  '  f  1  .•  a  ; 

point  error  message  kept  appearing  on  the  screen.  Arte; 
consulting  both  the  analyst  curie,  as  well  as  making  a  a  . 
to  the  SCOPE  -MOD  contractor  in  •order  to  ensure  that  th- 
fault  was  not  because  of  a  mi  sunderstand  i  ng  .  f  sys  r  fir. 
operation,  the  researches  and  St'OFE-  MOO  vendor  b  *  *  h  :  -n 
eluded  that  there  was  indeed  a  prob 1 em  with  t he  softwov  •. 
When  the  SCOPE-MOD  vendor  suggested  that  the  software  he 
used  on  a  microcomputer  with  a  mathematical  coprocessor ,  rv* 
was  advised  that  in  addition  t  :>  mat  hem  •  1 1  ca  1  coprocess  -.•rs 
being  unavailable  for  use  in  the  PRAM  office,  th*  C'd  1'  Ml; 
analyst's  guide  specified  that  the  only  requirement  list*  d. 
for  proper  SCOPE-MOD  utilization  was  an  I  DM  comp^t. i  L  '• 
microcomputer  with  a  hard  disk  and  256  Kilobytes  of  Panda;; 
Accessible  Memory  (39:3-1).  The  system  used  by  the  r*  • 
searcher  met  all  these  requirements. 

After  another  copy  of  the  SCOPE  -MoO  softwaic  w  is  r -.?<-•••  i 
ved  another  attempt  was  made  to  use  the  model.  Oui  mg  this 
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attempt  a  additional  problem  surfaced  wi 
th*'  made  any  further  use  undesirable.  "I 
countered  with  the  second  copy  of  the  50/ 
another  software  malfunction.  After  the 


t ion  was  added  to  the  baseline  data  set. 


nee  again  use  the  DYNAMO D  portion 


f  a  i  1  e d  a  f  t e r  one  day  i  n t 


run  <  DYNAMOD  pr  avides  the  user  wi 


a r. a  1  v s  i s  o  f  wa r 1 1 me  s r tie  c a o a b i  1  it v  . 


a  i  cu  1  at  i  ens  one  dav  at  a  time.;.  This  t 


re  reiving  a  'floating  point'  -rr 


rr.anv  sco;i' 


wijC  cl  ATM;  maximum  allowable  2v-0 


ratal  err  :1.  .  and  the  resear '"her  ecu!  i  n-r 


be  v  ;■  nd  t  h  i  s  o o  i  n  t  u s  i  no  f  h  i  s 


.  w  j  i 


The  work  unit  ceded  1 1  era  cans; 


error-  wa  s  leaded  into  the  baseline  -.fat  a  s 
vendor'  and  was  a  wrk  unit  code  unre  l.itf-i 


At  this  t  .  int  further  . ’''TTl  M;  -L-  ui 


-v:  r  or 


urinated  all  ■$<  ft  war--  rr  hi --ms. 


ade-gua'-  -  i v  acc  •me  1  is:. 


lues  t  :  :  :.a  b 1  e  .  Rather  f  nan  cont  irtue  w  1 1  la 


r.e  cc  ,  .-.  .-r-  c  s  r  *  w a  i  . 


more  ipr-i  nr  i  a  f  t  -  tie-  lev--!  1  a; 


14  1  7b l  F  by:;t-m  ;  : 


3.  LSC  version  2.0.  Initially,  this  model  was  c-r, 
sidered  for  its  capability  to  model  logistics  support  '  .:t .:  . 
Additionally.  L3C  did  not  require  an  inordinate  amount  er 
input  data. 

For  all  its  potential  advantages .  however,  LJC  1  *.  ~k-  i  a 
couple  of  features  which  made  its  use  inappropriate  : : r  this 
study.  First.  LSC  was  designed  to  model  logistics  supper r 
cost  .  As  such,  the  nt :*de  1  was  unable  to  include  a  variety  of 
specific  PRAM  protect  acquisition  costs.  Lo'C  al  sc  has  very 
limited  sensitivity  analysis  capability.  because  a  f  ex-  en- 
sive  data  uncertainty  experienced  during  the  pro  test  dam 
collection  process,  this  became  a  limiting  factor .  Another 
disadvantage  of  LSC  was  its  inability  to  perform  a ! ternat :ve 
cost  comparisons  on-  line.  Any  comparisons  of  an  ex  is- me 
system  or  sub- system  wi  r  h  a  proposed  alternative  would  hav- 
to  be  done  manually,  after  separate  cost  outputs  had  been 
generated  for  each  alternative.  This  last  limitation  ->r  L.’>' 
was  minor,  but  was  another  factor  which  eliminated  its  use 
m  this  study. 

4.  LCCHPC.  The  capabi  l  i  ty  of  this  microcompiii  <•{•  ver 
sion  of  LCCH  to  capture  all  appropriate  LCC  costs  lead  to 
its  inclusion  as  a  candidate  mode  I  d.uring  the  initial  m-aie  ! 
survey.  However .  the  serious  difficulty  was  encountered  in 
set  t  i  ng  up  daf  a  l  nput.  f  :  1  es  . 

The  mi  ''*■<  -computer  vet  s  i  > .{  I  a  ‘*.'11  did  not  cent  a  i  n  my 
provisions  t  a  out  m-i*  i  ■  -  i*  1  -oment  ;  input  data  riles.. 


The  mode  1  required  that  the  user  develop  uata  entry  files 
using  a  ASCII  text  editor.  While  the  documentation  did 
provide  examples  of  how  each  data  file  was  to  be  developed, 
it  was  the  user's  responsibility  to  determine  exactly  where 
each  value  was  to  be  placed  in  the  text  file.  This  entire 
procedure  was  complex  and  cumbersome.  It  ultimately  caused 
the  researcher  to  abandon  any  efforts  to  use  this  model. 


Quantitative  Analysis  Using  Selected  Models 

Only  two  of  the  candidate  models  surveyed  provided 
analysis  capabilities  that  matched  the  predetermined  anal¬ 
ysis  levels  required  for  each  of  the  three  projects  The 
Statistically  Improved  Life  Cycle  Cost  (31LCC )  model  was  tn 
most  i  d^var.t  model  for  performing  quantitative  analysis  f 
the  F-itO'T  Improved  Aircraft  Wheel  project.  The  Cost 
Analysis  and  Strategy  Assessment  Model  was  found  to  provide 
the  required  analysis  capabilities  for  both  the  C-i-11  VSCr 
System  project  and  the  AN/ALR-46/f 9  Signal  Processor  Power 
Supply  project.  The  rational  for  selecting  each  model  is 
described  in  the  subsequent  sections  detailing  t he  results 
of  the  quantitative  analysis  performed  for  each  project, 
along  with  the  limitations  of  eacn  model  .  3ILCC  i  i,;.:  r  gr  ;  -  n 
are  discussed  immediately  following  the  section  derailing 
the  quantitative  analysis  of  the  F-lbC/D  Improved  A i r  ~r i • t 
Wheel  project.  However .  as  CASA  was  used  to  perform  t  he 
quantitative  analysis  of  the  two  remaining  protects,  a 


description  of  its  limitations  does  not  occur  until  after 
the  discussion  of  the  AN/ALR-46/69  Signal  Processor  Power 
Supply  analysis. 

F-15C/D  Improved  Aircraft  Wheel 

Rational  for  Using  SILCC.  As  previously  described, 
the  decision  orientation  for  the  F-15C/D  project  was  one 
dimensional.  Eecause  of  the  higher  unit  cost  of  the  pro¬ 
posed  RST  wheel,  along  with  the  adequate  reliability  of  the 
existing  2014  wheel,  this  project  would  be  successful  only 
if  operational  and  support  costs  of  the  proposed  wheel  were 
significantly  lower  than  the  existing  wheel. 

Beside  the  need  to  examine  the  life  cycle  costs,  the 
amount  of  data  available  for  any  quantitative  analysis  was 
not  only  limited,  but  also  questionable  in  its  accuracy. 

The  integrity  of  the  wheel  information  available  from  MODAS 
was  suspect,  because  of  the  extremely  high  failure  rates 
reported  by  MODAS.  which  contradicted  by  the  data  available 
from  the  D041  factors  analysis  printout  as  well  as  data  fro 
the  landing  gear  equipment  specialist  at  Ogden  ALC . 

The  model  most  suited  for  analysis  of  this  project 
would  ideally  be  a  LCC  model  that  allowed  the  user  to  per¬ 
form  a  relatively  uncomplicated  analysis  using  the  limited 
amount  of  data  available.  Because  of  the  uncertainty  of 
many  of  the  key  data  elements  of  this  project,  this  model 


would  also 


>ng  s< 


Utivity  analysis  capabilities 
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have 


The  5ILCC  model  provided  both  of  those  capabilities. 
SILCC  adequately  accomplished  the  LCC  analysis  using  only 
variables  for  each  alternative.  In  addition  to  its  abiiit 
to  use  the  limited  amount  of  data  available,  the  model  in¬ 
cluded  the  capability  to  determine  the  sensitivity  of  each 
variable  to  a  percentage  change  in  its  value.  Not  only  di 
SILCC  provide  the  capability  to  rapidly  determine  the  sen¬ 
sitivity  of  any  single  variable  to  a  changes  in  its  value, 
it  also  provided  the  researcher  with  a  function  that  rank 
ordered  the  sensitivity  of  every  variable  in  the  model. 
This  feature  proved  to  be  especially  useful  because  it  im¬ 
mediately  displayed  those  variables  that  were  the  most 
sensitive  to  changes  in  value,  thereby  eliminating  the  tirn 
often  spent  trying  to  manually  determine  the  degree  of 
variable  sensitivity. 

An  important  characteristic  of  SILCC  that  was  net 
offered  by  any  other  model  surveyed  was  the  extensive  use 
made  of  existing  Air  Force  data  systems  for  model  input. 
Indeed,  the  main  premise  of  developing  3 I LCC  was  that  "its 
data  support  should  be  met  entirely  by  standard  l  n  format  10 
systems  currently  existing  in  the  Air  Force"  (37:5).  The 
user  documentation  listed  the  primary  Air  Force  source  for 
every  data  element  used  by  the  model,  often  supplementing 
the  data  system  reference  with  a  specific  point  of  contort 
(37:3-29).  Additionally.  SILCC  documentation  not  only 


acknowledged  the  possibility  of  problems  with  data  icon  oc 


but  provided  two  options  for  dealing  with  this  problem. 


first  methodology  was  through  the  capability  to  provide  the 
decision  maker  with  a  statistical  confidence  level  of  LCC 
totals  and  each  output  variable.  This  was  accomplished  by 
allowing  the  researcher  to  specify  a  probability  that  input 
parameter  mean  will  vary  from  its  actual  value,  and  then 
used  descriptive  statistical  techniques  to  calculate  the 
range  of  the  given  parameter  value.  The  second  methodology 
for  dealing  with  data  uncertainty  was  through  the  use  of  it 
extensive  sensitivity  analysis  previously  mentioned. 

Ease  of  data  entry,  the  capability  to  provide  on- line 
alternative  comparisons,  and  the  unambiguous  output  reports 
generated  by  SILCC  were  three  other  powerful  features  that- 
increased  its  value.  Data  entry  for  each  alternative  was 
accomplished  on  a  single  screen.  After  data  entry  was  corn 
pleted,  data  files  were  saved  through  a  single  keystroke 
action.  SILCC  ability  to  provide  on-line  LCC  comparisons 
between  alternatives  allowed  for  the  researcher  to  quickly 
examine  how  any  changes  in  one  of  the  input  variables  af¬ 
fected  the  difference  in  total  LCC  between  the  two  alter¬ 
natives.  Finally,  in  addition  to  the  many  computational 
output  reports  provided  by  SILCC.  it  provided  the  recearche 
with  a  limited  number  of  output  graphs  highlighting  how 
total  LCC  costs  were  affected  by  changes  in  four  key 
variables  (MTBD.  MTBR ,  Depot  Maintenance  Manhour  Costs,  and 


Base  Maintenance  Manhour  Costs) 


Analysis  Using  SILCC.  Using  all  the  data  from  the 
F-15C/D  Improved  Aircraft  Wheel  for  the  baseline  analysis 
(see  Appendix  E  and  F  for  initial  data  inputs),  the  initial 
results  shown  in  Table  6  illustrated  that  only  $7522  dollar 
separated  the  two  alternatives;  the  delta  being  only  .22 
percent  of  total  LCC  over  a  20  year  period.  After  perform¬ 
ing  a  ranked  sensitivity  analysis  of  all  variables,  it  was 
noted  that  the  base  no  repair  this  station  (NRTS)  for  the 
wheel  ranked  fourth  on  the  sensitivity  analysis  rep*rt  for 
both  the  existing  and  proposed  alternatives.  Of  the  three 
variables  listed  before  the  NRTS  rate,  only  the  mean  time 
between  removal  (MTBR)  data  element  was  a  variable  winch 
might  have  some  uncertainty  associated  with  it.  However, 
because  of  previous  conversations  with  the  Deputy  Item 
Manager  at  Ogden  and  the  PRAM  project  manager,  the  original 
five  percent  NRTS  rate  became  immediately  suspect  after  the 
initial  LCC  comparisons  were  made  and  a  ranked  variable 
sensitivity  analysis  report  was  generated.  A  closer  ex¬ 
amination  of  the  input  data  revealed  that  the  number  of 
annual  base  wheel  repairs  generated  was  only  about.  30  per¬ 
cent  of  total  annual  wheel  repairs,  with  depot  repair  ac¬ 
counted  for  the  remaining  70  percent  (162  annual  base 
repairs  versus  533  annual  depot  repairs) .  A  second  LCC  com 
pari  son  was  made  using  these  repair  percentages  as  base 
repair  this  station  (RTS)  and  base  NRTS  rates.  As  Table  ~ 


illustrates,  the  large  change  in  the  NRTS  rates  had  a 


Table  6 


Results  of  F-15C/D  Improved  Aircraft 
Baseline  Analysis  Using  Original  NRTS 
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Life  Cycle  Cost  Comparison 
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CNLV 

- 

2014alui 

.950 

newrst 

.950 

BSTK 

- 

5. 

3. 

DSTK 

- 

3 

- 

2. 

QCS 

- 

35. 

- 
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BMMH 

H 

261. 

H 

174. 

DMMH 

H 

187. 

H 

125. 

PMSH 

H 

14. 

H 

9. 

DEVC 

$ 

0. 

$ 

0. 

SYS  I 

$ 

0. 

$ 

846500. 

SEC 

S 

0. 

$ 

0. 

BSC 

t 

372900. 

$ 

257400. 

BMHC 

$ 

548791. 

$ 

365860. 

BMMC 

$ 

19850. 

$ 

13233. 

DSC 

$ 
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1 
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S 
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$ 
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$ 
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$ 
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$ 
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$ 

237300. 

$ 
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$ 
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$ 
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* 
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$ 

2512225. 

AVE/YR 

t 
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% 
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Delta 

.00  X 

-40.00  X 
-33.33  X 
-31.43  X 

-33.33  X 
-33.33  X 
-33.33  X 

.00  X 
9999.99  X 
.00  X 
-30.97  X 
-33.33  X 
-33.33  X 
-23.30  X 
-33.33  X 
-63.99  X 
-33.33  X 
-21.11  X 
.00  X 

-.22  X 

-.22  X 
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Table  7 
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% 
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% 
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dramatic  effect  on  the  total  LCC  difference  between  the 
current  and  proposed  wheel.  With  a  base  NRTS  rate  of  70 
percent,  the  proposed  R5T  wheel  LCC  costs  were  about  $3.2 
million  dollars  less  than  the  current  20i4  wheel  (a  33 . 77% 
delta).  Because  the  number  of  actual  repairs  accomplished 
was  a  more  accurate  figure  than  trie  original  NRTS  rates 
reported  by  both  the  D041  and  the  item  manager,  these  LCC 
figures  became  the  baseline  results  for  the  F-15C/D  analysis 
using  SI LCC. 

Higher  NRTS  rates  also  had  significant  effects  on  total 
LCC  differences,  although  additional,  increases  in  percent  of 
change  were  not  nearly  as  great.  A  base  NRTS  of  95  percent 
produced  a  total  LCC  cost  difference  of  over  $4.6  million 
dollars  (a  36.9  percent  difference).  Increasing  the  base 
NRTS  rate  to  100  percent .  produced  a  total  LCC  cost  dif¬ 
ference  of  over  5  million  dollars  (a  37.33  percent  delta) . 

In  each  case,  the  RST  proposal  showed  significant  reductions 
in  operational  and  support  costs. 

In  addition  to  examining  the  sensitivity  analysis  of 
the  NRTS  rates,  the  values  of  the  ten  variables  identified 
as  most  sensitive  to  change  were  varied  by  at  least  25 
percent.  Table  8  shows  the  effect  of  each  change  on  total 
LCC.  While  many  changes  had  great  effect  on  the  absolute 
value  of  LCC  costs,  most  of  the  deltas  between  the  two 
proposals  were  only  affected  by  about  3  to  4  percent. 
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Table  8 


Results  of  F-15C/D  Improved  Aircraft  Wheel 
Sensitivity  Analysis  Using  the 
Ten  Most  Sensitive  Variables  Identified  by  SILCC 

Variable  and 


Sens  i 

ti  vity 

Percent 

20 14 

RST 

Rank i ng 

Change 

LCC 

LCC 

De  i  ta 

PIUP 

( 1  ) 

25%  decrease 

$7268131 

$5033475 

30 . 75% 

MTBR 

(2) 

25%  decrease 

( RoT ) 

$9589140 

$8021467 

16 . 35% 

AOH 

(3) 

25%  decrease 

$7327188 

$5092533 

30 . 50% 

AOH 

(3) 

25%  increase 

$11851090 

$76019 3  3 

NRTS 

(4) 

25%  increase 

$11645530 

$7417434 

3  6.31  '3 

NRTS 

(4) 

25%  decrease 

$7464943 

$5 191232 

3u . 46% 

PSC 

(5) 

25%  increase 

$10704320 

$7094586 

"4  7  7  .  -  7. 

nMC 

(7) 

25%  increase 

(  RST ) 

$9589140 

$6651265 

30 . 643: 

SYSI 

(8)  * 

25%  increase 

(  RST ) 

$9589 i40 

£6562758 

Cl .06 1 

SYSI 

(  3)  * 

50%  increase 

(  RST ) 

$9589140 

$6774383 

29 . 35  - 

SYSI 

t  a  >  * 

100%  increase 

( RST ) 

$9539140 

$7197633 

24 . 946 

DLR  ( 8 

,10)  *  * 

25%  increase 

$9738051 

$6450407 

33 , 76% 

ni\AT  r  *  <" 

,ii)**k 

25%  increase 

$9745177 

$6455157 

1  -7  ^ 

UC  (  1 0 

_  9  )  *  *  *  * 

25%  increase 

(RST) 

$9589140 

Soe564 j3 

32 , 6 76 

UC(  10 

0  )  *  *  *  * 

50%  increase 

(  RST ) 

$9589140 

$65617 3 3 

31 .57  t 

Def 1  nit  ions 

PIUP  -  Projected  Inventory  Usage  Period 
MTBR  -  Mean  Time  Between  Removal 
AOH  -  Annual  Operational  Hours 
NRTS  -  Base  No  Repair  This  Station 
PSC  -  Packing  and  Shipping  Costs 
DMC  -  Depot  Material  Costs 
SYSI  -  System  Investment  Costs 
DLR  -  Depot  Labor  Rate/Manhour 
DMH  -  Depot  Maintenance  Manhours 
UC  -  Unit  Costs 

NOTES 

*  SYSI  sensitivity  analysis  ranked  8th  for  RET  alter 
native  only;  2014  alternative  had  no  SYSI  costs 

*  *  DLR  sensitivity  analysis  ranked  8th  for  2014  alter 
native;  10th  for  RST  alternative 

*  *  *  DMH  sensitivity  analysis  ranked  9th  for  2014  alter¬ 
native;  11th  for  RST  alternative 

*  *  *  *  UC  sensitivity  analysis  ranked  10th  for  2014 
alternative:  9th  for  RST  alternative 


However  two  variables  having  a  large  impact  of  total  LCC 
were  (a)  the  effect  of  increasing  the  development  costs  of 
the  proposed  RST  wheel  and  (b)  a  decrease  In  mean  time 
between  removal  (MTBR) .  As  Table  8  illustrates,  a  25  per¬ 
cent  reduction  in  MTBR  time  of  the  proposed  RST  wheel  would 
result  In  only  about  a  SI. 5  million  dollar  LCC  savings, 
which  is  a  significant  reduction  from  the  baseline  savings. 
LCC  comparisons  were  made  with  the  RST  development  costs  in 
creased  to  over  50  and  100  percent  of  the  proposed  RST  pric 
in  order  to  examine  how  RST  development  overruns  affected 
the  feasibility  of  the  project.  Table  8  also  shows  an  100 
percent  increase  in  RST  development  costs  reduces  the  total 
LCC  savings  of  the  proposed  RST  wheel  to  about  $2.4  million 
do  1 1 ars  . 

Fi nd l nqs .  The  baseline  analysis  (using  a  NRTS  rate 
of  70  percent)  demonstrated  that  the  total  LCC  cost  savings 
of  the  using  the  RST  wheel  as  opposed  to  the  current  2014 
wheel  were  about  $3.2  million  dollars.  This  demonstrated  a 
positive  return  on  investment  of  about  3.8  to  1.  a  figure 
significantly  lower  than  the  original  PRAM  Project  Plan 
f igure  of  i 2 . 6  to  1 . 

Analysis  showed  that  one  of  the  most  important  vari¬ 
ables  affecting  the  differences  in  LCC  between  the  two 
alternatives  was  the  base  NRTS  rates.  The  less  capability 
that  the  base  level  maintenance  has  to  repair  the  wheel,  th 
more  attractive  the  proposed  RST  wheel  alternative  becomes. 
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This  was  an  important  result  of  the  analysis  because,  al¬ 
though  the  NRTS  rates  reported  in  the  D041  were  only  five 
percent  of  all  repairs,  the  Landing  Gear  Deputy  Item  Manag 
at  Ogden  ALC  stated  that  almost  all  work  done  on  F-15C/D 
wheels  was  performed  at  the  depot  maintenance  level  ■:  35  '  . 
Indeed,  if  the  base  level  NRTS  rates  were  iOO  percent,  the 
RST  LCC  savings  would  be  over  $5  million  dollars,  mcreasi 
the  project  ROI  to  over  5.9  to  i. 

The  other  significant  variable  affecting  project  cost 
savings  was  wheel  MTBR .  The  RST  wheel  proposed  to  improve 
wheel  MTBR  by  over  50  percent,  to  over  1002  hours.  If  t h ' 
proposed  improvement  was  understated,  the  cost  savings  wou 
be  reduced  to  about  $1.5  million  dollars,  thereby  reducing 
the  project  ROI  by  to  approximately  1.9  to  1. 

The  most  important  finding  of  this  analysis  is  was  t h 
although  SI LCC  reported  LCC  savings  significantly  lower  tn 
reported  by  the  initial  PRAM  Project  Plan,  an  extensive 
amount  of  sensitivity  analysis  revealed  that  this  project 
would  still  provide  substantial  cost  savings  under  many 
changing  assumptions.  Only  if  the  inaccurate  NRTS  data  wa 
assumed  correct  wou 1 d  the  cost  savings  be  marginal. 

SILCC  Limitations 

As  useful  as  3 I LCC  was  in  preforming  this  analysis,  i 
was  not  without  its  limitations.  Perhaps  the  most  serious 
limitation  of  SILCC  was  its  inflexibility  to  handle  change 
to  spares  provisioning  policy.  SILCC  calculates  base. 
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depot,  and  condemnation  spares  using  optimal  spares  prov 
sioning  formula  based  on  manipulating  system  peak  monthl 
operating  hours  (POH).  pipeline  time,  mean  time  between 
demand  (MT3B) .  and  the  number  of  weapon  system  basing  lo 
tions  (37:38).  Using  the  baseline  data  set.  SILCC  es".  im 
that  between  base,  depot,  and  condemnation  spares  reguir 
ments.  the  2014  would  require  86  spares  versus  54  spares 
required  for  the  RST  option.  However,  the  Landing  Hear 
Division  at  Ogden  ALC  has  a  current  spares  invent  try  of 
main  landing  gear  wheels,  and  the  new  RST  proposal  rugae 
only  a  need  for  about  235  spares  <43:0).  While  one  mioh 
debate  the  necessity  of  keeping  such  a  large  supply  of 
spares,  especially  for  the  201-1  wheel,  the  fact  remains 
that,  for  whatever  reason  the  pri icy  of  stocking  lOf'-u 
spares  is  current  depot  maintenance  policy.  SILCC  has  n 
mechanism  to  adjust  the  number  of  base  level,  depot  leva 
or  condemnation  spares.  In  order  to  determine  the  exact 
for  both  alternatives,  the  analyst  would  have  t_o  deter mi 
the  cost  effects  of  the  actual  and  proposed  spares  prov: 
sioning  policies  and  manually  add  the  cost  of  any  a- Id 1 1 i 
spares  acquisition  to  the  LCC  results  generated  by  CILCC 
Fortunately,  because  all  needed  spares  had  aiia-ady  u, 
procured,  this  problem  had  little  effect  on  the  over  a  1  i 
'  j  n  ti  i  y  s  1 3  . 

SILCC  was  also  quite  limited  in  its  capoti  1  i  ‘  y  ♦  ■  r:; 
several  categories  of  LCC  costs  .  Systems  and  Lew  i-.g  :m-n 
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Costs  could  only  be  entered  as  throughput  costs .  Su 
Equipment  Costs  could  also  only  be  entered  us  throug 
costs.  Additionally.  SILCC  did  not  have  any  capabil 
model  recurring  support  equipment  costs,  documentati 
costs,  or  training  costs.  While  none  of  these  limit 
had  a  direct  impact  on  the  F-I5C/D  Improved  Aircraft 
Study,  had  it  been  important  to  capture  any  of  these 


C  ■ :  i  C"  '  it  *r  ■  1  O  3  ■  ■  C  1  U  t  e .  *  i’i  i.  i  1  Pi  t  “•  U  ..i  H  C  ■  ■ 1  V» . .  \  ■ '  i  i  .  ""  ,'U1  1 

icaliy  and  at  unequal  intervals  t  hi  -u  ;h<-ut  Me-  s- 


1M 


per i od . 


Under 


the  existing  CSD  alternative.  CUD  fa 
or  may  not  require  repair  of  the  electrical  general 
associated  with  it.  The  only  generator  repair  data 
able  for  analysis  was  the  number  of  generators  re pa 
annually  and  the  total  annual  generator  repair  cos* 
important  that  a  model  be  able  to  somehow  handle  th 


The  Cost  Analysis  and  Strategy 
was  the  only  model  with  the  capabi 1 
unique  requirements.  I*  had  sever a 
a c q u i sit: o n  c o sta  w'n :  c h  a  1  low? d  f or 
:>  f  t  h e  p ro posed  V C C F  a c q u  l  s  i  1 1  o n  c 
allowed  the  annual  generator  repair 


Assessment  ( C  A  2' 


ity  to  handle  th 
i  c  a  t  e  ■  t  o  r  i  e  s  o  f 
more  accurate  m 


ma 


CASA  had  some  ether  features  which  t  a  - :  1  1 1  a  r i 
titative  analysis  of  the  C-l-iiA/E  system.  The  made 
mi t ted  rapid  entry  of  a  large  amount  of  data  throug 
series  c  f  menu  driven  input  screens.  As  with  SILCC 
allowed  quick  on-line  cost  comparisons  to  be  mad-  a 
number  or  variable  changes  had  b  e  r.  made.  Tins  tea 


analyses  on 
ability  for 
:  r  inf  1  .a  1 1  o  n 
op  per  turn  tv- 


researcher  to  perform  a  number  of  sens: 
several  input  variables.  Additional ly . 
the  model  to  assess  an  infinite  number 
and  discount  rates  gave  the  researches 
t  .  present  dec  man  makers  with  a  mi  e 
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assessment  of  true  operational  and  support  costs  vf  f: 
alternatives  being  considered. 

Besides  the  great  flexibility  it  demonstrated  m 
forming  this  particular  analysis.  CASA  offered  the  re¬ 
searcher  a  unique  capability  to  quantify  project  risk 


allowed  the  researcher  to  estimate  a  number 


:ri but  ions  of  unit 


.  MiBF.  and  mean 


: MTTR) .  then  use  these  distributions  in  performing  _:p 
lOOu  iterations  of  a  Monte  Carlo  simuioti.r.  module  rr; 
ateiy  named  RI3KMC .  The  RI3K0UT  module  then  lisp  lays 
100  percent  LCC  prooabi l ities  for  the  alternative  ten 
analyzed,  and  calculates  the  strength  of  the  simulut : 
using  both  the  alpha  and  beta  srrusticai  f.®sts . 

Although  the  data  input  modu  1  e  of  o' AC  A  c  or.t  a  i  n- i 


34  categories  of  information  and 


separate  data  err 


screens .  arrother  capaci  1  ^  tv  o>f  CALA  that  am  — d  treneni 
to  its  flexibility  was  its  abilito  t^  w.-rk  off  a  Irm* 
data  set  and  still  produce  workable  results,  m  contra, 
many  rrn  croc-'mputer  log  ist  ics  surror  t  m  :-h'  Is  *Lit  v;  i  :  ; 
execute  unless  --roam  d- fault  pnrnm-te. s  ar>-  err:-;  -  .1 
input;: .  However.  when  using  CA3A  .  'with  a  r  ew  or  :  ".  :  ca  1 
except  ions .  if  parameters  must  be  zeroed  .->uf  be  'a  us-  _• 
availability  of  data,  those  parameters  are  ion- .red  wn- 
per  f  or  ms  LCC  o.i  i  cu  1  a  1 1  •  >r.s  . 

A  final  reason  why  C ALA  was  c loosen  t'-  ac rong  !  ; . "h 
ana  iys  is  was  becaure  r  f  f  he  ever  growing  r 


use  within  both  the  Air  Force  and  the  DOD  support abi 1 i ty 
community.  Additionally,  several  independent  studies  ha 
validated  both  the  model's  accuracy  and  statistical  robu 
ness  (25:35.  33:335.  21:12). 

Analysis  Using  CASA.  The  data  elements  from  the 
C-141A/B  VSCF  System  project  data  analysis  worksheet  wer 
used  as  data  sets  for  baseline  analysis  (See  Appendix  I 
J  for  model  inputs).  As  Table  9  illustrates,  the  t  ;•  t  a  1 
of  the  proposed  VSCF  system  was  slightly  more  than  $7;j .  j 
million  dollars  above  the  total  LCC  costs  of  the  exist m 
CSD  system  ta  102.2  percent  delta).  While  the  VSCF  cyst 
demonstrated  a  significant  savings  in  operational  and  si.; 
port  cost  over  the  existing  CSD  system  (slightly  mom  fh 
$52.8  million  dollars),  the  consider  able  front  end  deve i 
ment  and  imp  lernentat  ion  <:_>sts  of  the  pr-;  posed  VSCF  cyst- 
(over  $136.2  million  dollars)  negated  the  estimated  opei 
tional  and  support  cost  reductions  of  the  VSCF  system. 

While  CASA  allowed  the  researcher  to  change  any  nuns 
of  input  variables  and  examine  the  effect  of  the  change 
each  alternative  LCC .  its  SENSE  module  let  the  t  -sea  re  ro¬ 
per  form  direct  sensitivity  analysis  or  unit  cost.  MTBF . 
MTTx  by  input  mg  desired  percentage  changes  to  the  fir .  M 
or  MTTR  baseline  variable  values.  Table  10  highlights 
results  or  this  sensitivity  analysis  for  the  VSCF  a  it 
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five. 


Table  9 


Results  of  C-141A/B  CSD  vs  VSCF  Baseline  Analysis 


COST  COMPARISON  (1985  DOLLARS  x  1000)  07-04-89 

***  TOTALS  OVER  ALL  YEARS  *** 

Base:  C-141  Constant  Speed  Drive 

Alternative:  C141  Variable  Speed  Constant  Frequency  Drive 

Total  Total 


Base 

Alternative 

Diff 

XDiff 

ACQUISITION  COSTS 

TOOLING  AND  T.E. 

.0 

.0 

.0 

.0 

START  UP 

.0 

.0 

.0 

.0 

SYSTEM  ACQUISITION 

.0 

108199.0 

108199.0 

.0 

SHIPPING  CONTAINERS 

.0 

.0 

.0 

.0 

PRE-PROD  ENG  CHANGES 

.0 

1600.0 

1600.0 

.0 

PRE-PROD  REFURBISH 

.0 

.0 

.0 

.0 

INSTALLATION 

.0 

16260.0 

16260.0 

.0 

SUPPORT  EQUIPMENT 

.0 

.0 

.0 

.0 

HARDWARE  SPARES 

5051.2 

3203.5 

-1847.7 

-36.6 

SPARES  REUSABLE  CONT 

.0 

.0 

.0 

.0 

INITIAL  TECH  DATA 

.0 

.0 

.0 

.0 

INITIAL  TRAINING 

.0 

.0 

.0 

.0 

TRAINING  DEVICES 

.0 

.0 

.0 

.0 

NEW  FACILITIES 

.0 

.0 

.0 

.0 

INITIAL  ITEM  MGMT 

.0 

.0 

.0 

.0 

MI  SC  ACQ  COSTS 

.0 

7000.0 

7000.0 

.0 

warranty 

.0 

.0 

.0 

.0 

TOTAL  ACQ  COST 

5051.2 

136262.5 

131211.3 

2597.6 

OPERATION  4  SUPPORT  COSTS 

OPERATION  LABOR 

.0 

.0 

.0 

.0 

REPAIR  LABOR 

5868.7 

2340.1 

-3528.6 

-60.1 

SUPPORT  EQUIP  MAI  NT 

.0 

.0 

.0 

.0 

RECURRING  TRAINING 

.0 

.0 

.0 

.0 

REPAIR  P.ARTS  AND  MTL 

45861.6 

13425.8 

-32435.8 

-70.  7 

CONSUMABLES 

.0 

.0 

.0 

.0 

CONDEMNATION  SPARES 

.0 

.0 

.0 

.0 

TECH  DATA  REVISIONS 

.0 

.0 

.0 

.0 

TRANSPORTATION 

7695.2 

3068.5 

-4626. 7 

-60. 1 

RECURRING  FACILITIES 

.0 

.0 

.0 

.0 

RECURRING  ITEM  MGMT 

.0 

.0 

.0 

.0 

CONTRACTOR  SERVICES 

.0 

.0 

.0 

.0 

ENGINEERING  CHANGES 

.0 

.0 

.0 

.0 

MI  SC  O  4  S  COSTS 

12225.0 

.0 

-12225.0 

-100.0 

TOTAL  04S  COST 

71650.5 

18834.  4 

-52816.1 

-73.7 

TOTAL  COST 

76701.7 

155096.9 

78395.2 

102.2 
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Table  10 


Sensitivity  Analysis  Examining  LCC  Effects  of  Changing 
VSCF  MTBF .  MTTR.  and  Unit  Costs  While  Holding  C3D  Costs 
Constant  (in  thousands  of  dollars) 


Percent  Diff  in  both 


of  VSCF 

CSD 

VSCF 

Dollars  and 

Variable 

Base  line* 

LCC 

LCC 

Percentage 

MTBF 

c: 

-J 

$76701 . 6 

$217559 . 8 

$140858 . 2 

!  »  OH 

t  ±  -J 

.  63. 

MTBF 

50 

$76701 . 6 

$175942 . 7 

$99241 . 1 

(  129 

.  44 

MTBF 

75 

$76701 . 6 

$162045 .4 

$  8  5  3 4  3 . 8 

(lil 

.  J'o 

MTBF 

100 

$76701 . 6 

$155096 . 8 

$73395 . 2 

(102 

Ci/ 

.  O 

MTBF 

125 

$76701 .6 

$150957 . 5 

$74255 . 9 

(  96 

.  84 

MTBF 

150 

$76701 .6 

$147328 . 7 

$  /  0  6  2  7 . 1 

<  92 

.  14 

MTBF 

225 

$76701 . 6 

$142621 . 8 

$65920 . 2 

<  35 

.  94 

MTBF 

300 

$76701.6 

$140030 . 5 

$6  3328 . 9 

;  y  2 

.  64 

MTTR 

25 

$76701 . 6 

$153341 . 7 

$76640 . 1 

(99 

.  94 

MTTR 

50 

$  7  6  7  0 1 . 6 

$153926 . 8 

$77225 . 2 

(  100 

"~f  O/ 

MTTR 

75 

$76701 . 6 

$154511 .3 

$77810 . 2 

;  10  i 

.  4’*o 

MTTR 

100 

$  7  6  7  0  1  .  6 

$155096 . 8 

$73395 . 2 

i  1 0  2 

I  •: 

.  _  0 

MTTR 

125 

$76701 . 6 

$155681.9 

$78930 . 2 

(  102 

.  94 

MTTR 

150 

$  7  6  7 0 1 . 6 

$156226 . 9 

$79525 . 3 

(103 

-7  0 
.  !  O 

MTTR 

225 

$76701 . 6 

$158022 . 0 

$01320.4 

(  106 

.  04 

MTTR 

300 

$76701 . 6 

$159777 . 1 

$33075 .5 

(  103 

.  34 

UC 

25 

$76701 . 6 

$71545 . 0 

$-5156.6 

(  -o 

.  74 

uc 

50 

$76701 . 6 

$99395 . 6 

$22694 . 0 

(  29 

.  64 

uc 

1  cr 

$76701 . 6 

$127247 . 9 

$50546 . 3 
$78395 . 2 

1  65 

'  4  '■  L. 

uc 

100 

$76701 . 6 

$155096 . 8 

(  102 

4  O. 

uc 

1  25 

$  7  6  7  0 1 .6 

$182945.4 

$1064 3 . y 

1  138 

. 

uc 

150 

$  7  6  7  0 1 . 6 

$210801 . 4 

$134099 . 8 

i  1"4 

.  84 

uc 

225 

$7670 1 . 6 

$294347 . 5 

$217645 . 9 

(  28  3 

.  84 

uc 

300 

$76701 . 6 

$377908 . 5 

$301206 . 9 

(  39  2 

—70 

*  VSCF  MTBF  Baseline  =  4000  hrs 
VSCF  MTTR  Baseline  =  16  hrs 
VSCF  UC  Baseline  =  $74,500.00 
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Sensitivity  analysis  was  also  conducted  for  the  unit 
cost,  MTBF ,  and  MTTR  of  the  existing  CSD  alternative. 
Because  the  existing  values  of  these  parameters  were  con¬ 
sidered  relatively  "hard"  data,  in  contrast  to  the  unteste 
data  presented  for  the  V5CF  alternative,  the  CSB  baseline 
values  were  only  varied  by  a  range  of  25  to  125  percent. 
Table  11  contains  the  results  of  the  CSD  analysis. 

Besides  the  sensitivity  analysis  conducted  for  the  o'" 
MTBF.  and  MTTR .  for  each  alternative,  many  other  maintenun 
variables  were  changed  to  determine  their  effect  on  costs. 
These  changes  included  decreasing  the  years  of  useful  cyst 
life,  increasing  and  decreasing  the  number  of  monthly 
operating  hours,  and  decreasing  the  base  NRTS  rate. 
Additionally,  the  effects  of  inflation  and  discounting  -in 
overall  Life  Cycle  Costs  were  examined.  Table  L2  highliqh 
the  results  of  these  sensitivity  analyses. 

In  addition  to  performing  the  above  sensitivity  anal¬ 
ysis.  risk  analysis  was  performed  on  the  VSCF  alternative, 
using  the  RI5KMC  module.  The  risk  analysis  was  performed 
in  an  attempt  to  account  for  the  'soft"  VSCF  data,  as  w-- 1  1 
as  to  demonstrate  the  risk  analysis  capabilities  of  CASA. 
The  RISKMC  module  is  a  Monte  Carlo  simulation  program  whic 
allows  the  researcher  to  establish  both  a  value  range  for 
Unit  Costs.  MTBF.  and  MTTR.  and  select  probability  distrib 
lions  for  the  chosen  values.  After  the  values  of  each 
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Table  11 

Sensitivity  Analysis  Examining  LCC  Effects  of  changing 
CSD  MTBF .  MTTR .  and  Unit  Costs  While  Holding  VSCF  Costs 
Constant  (in  thousands  of  dollars) 

pAvppnf  Diffinboth 


of  CSD 

VSCF 

CSD 

Dollars  and 

Variable 

Base  line* 

LCC 

LCC 

Percentage 

MTBF 

25 

$155096.8 

$267185 . 0 

$112088.2  (72.3V 

MTBF 

50 

$155096 . 8 

$140035 . 7 

$-15061.1  (-9.7%' 

MTBF 

75 

$155096 . 8 

$97833 . 0 

$-57263.8  (  -  36 . 9% 

MTBF 

100 

$155096 . 8 

$76701 . 6 

$-78395.2  (-5C.5V 

MTBF 

125 

$155096.8 

$64034 . 8 

$-91062.0  (-58.7% 

MTTR 

n  G 

$155096 . 8 

$72  j00 . 1 

$-82796.7  (-53.4% 

MTTR 

50 

$155096.8 

$73767 . 1 

$-81329.7  (-52.4% 

MTTR 

75 

$155096.8 

$75234 . 5 

$-79862.3  v -5 1 . 5% 

MTTR 

100 

$155096.8 

$76701 . 6 

$-78395.2  (-50.  S';*. 

MTTR 

125 

$155096 . 8 

$78168.8 

$-76928.0  (-49,6% 

UC 

25 

$155096 . 8 

$72913 . 2 

$-82183.6  (-5 1.0% 

UC 

50 

$155096 . 8 

$74176 . 0 

$-80920.8  (-52.2% 

UC 

75 

$  155096 . 8 

$75433.8 

$-79658.0  (-51.4% 

UC 

100 

$15509o.8 

$76701.6 

$-78395.2  (-50.5% 

UC 

125 

$155096.8 

$77964 . 6 

$-77150 .2  (  -49 . 7% 

*  CSD  MTBF  Baseline  =  1595  hrs 
CSD  MTTR  Baseline  =  16  hrs 
CSD  UC  Baseline  =  $60,133.76 


Table  12 

Results  of  C-141A/B  VSCF  System 
Sensitivity  Analysis  for  Selected  Variables 


Using  CASA  (in  thous 

and s  of  do 

i  1  ars  > 

Percent 

CSD 

VSCF 

Variable 

Change 

LCC 

LCC 

De  1 1  a 

Useful  Life  25%  decrease 

$56639.4 

$149823 . 2 

1 64 . 5'-,. 

System  Op 

Hours  25%  increase 

$92521 . 9 

$160  327 . 5 

"7  *) 

■J  .  J 

System  Op 

Hours  25%  decrease 

$60821 . 3 

$  149046 . 6 

145 . 1% 

NRTS  rate 

25%  decrease 

$60621 . 3 

$  145852 . 5 

1 3  9 . 3  % 

MTTR 

300%  increase 

$00439 . 0 

$159777 . 2 

60  .  7% 

Inflation 

5%  per  year 

$148929 . 9 

$180829 . 7 

2  L  .  -1% 

Inf  1  at  ion 

and 

Discount 

rate  5%Inf /10%Disc 

$46196 . 9 

$140944 . 8 

205  .  L% 

1 1 


variable  and  their  probability  distributions  have  been 
selected.  RISKMC  allows  the  researcher  to  choose  between  50 
and  1000  iterations  of  the  simulation.  After  the  number  of 
iterations  is  chosen,  RISKMC  ’‘fits"  the  values  chosen  to  the 
probability  distribution  selected  and  the  number  of  itera¬ 
tions  chosen.  The  resulting  output  is  a  prediction  of  LCC 
probabilities  based  on  the  probability  distribution  selected 
and  the  number  of  iterations  chosen. 

For  risk  analysis  of  the  C--141  VSCF  alternative.  Table 
13  shows  the  parameters  selected  for  unit  cost.  MTBF .  and 
MTTR .  The  unit  cost  of  the  VS'CF  was  varied  from  its  pro¬ 
posed  price  to  a  value  representing  a  25  percent  cost  in¬ 
crease.  The  MTBF  value  was  varied  in  order  to  capture  a  25 
percent  decrease  to  50  percent  increase.  Finally,  the  MTTR 
value  was  varied  to  capture  a  25  percent  decrease  to  a  fifty 

Table  13 


Parame 

ters  Selected 

for  C- 141  A/13 

VSCF 

Risk  Analysis 

Variable 

Distr lbut ion 

L  O  W  O  3  f  V  ■  i  i 

ue 

Highest  Value 

'  J  n  i  t  C  o  s  t 

Un i f  orm 

$74 . 500 

$03. 125 

MTBF 

Uni  form 

3000  hrs 

6000  hrs 

MTTR 

Uni  form 

32  hrs 

64  hi  s 

percent  increase  in  the  depot  maintenance  hours  required  to 
repair  the  VSCF.  As  the  probability  distribution  or  this 


proposed  data  was  unknown,  the  researcher  chose  to  use  a 
uniform  distribution. 

The  maximum  number  of  iterations  (1000)  was  chosen  for 
the  Monte  Carlo  Simulation  in  an  effort  to  increase  its 
statistical  significance.  Figure  5  indicates  the  results  ol 
the  C-141A/B  VSCF  risk  analysis. 

Fi nd i nas .  The  baseline  LCC  comparison  indicated 
that  implementing  the  VSCF  alternative  would  increase  LCC 
costs  by  about  102.2  percent  of  the  existing  CSD  system  over 
an  estimated  25  year  useful  life  of  the  C-141A/B  fleet. 
Additionally,  the  calculated  ROI  of  this  project  was  sig¬ 
nificantly  less  than  one. 

The  analysis  performed  by  using  CASA  indicated  that  the 
initial  analysis  done  by  the  PRAM  staff  had  overestimated 
the  ROI  of  the  VSCF  alternative.  The  cost/bene f i ts  caloula 
tions  performed  by  PRAM  staff  analysis  estimated  that  the 
C-141A/B  project  ROI  was  .51  to  1.  The  baseline  analysis  :t 
the  VSCF  alternative  using  CASA  estimated  a  ROI  of  .34  to  i. 

The  sensitivity  analysis  capabilities  of  CASA  showed 
that  except  for  a  couple  of  extreme  cases,  the  existing  CSD 
alternative  proved  to  be  the  more  viable  cost  option.  Under 
all  scenarios  examined,  the  only  times  that  the  VSCF  option 
proved  to  be  the  more  viable  alternative  was  when  the  VSCF 
MTBF  was  obtainable  and  the  current  CSD  MTBF  was  over¬ 
estimated  by  75  percent,  or  if  the  proposed  VSCF  unit  cost 


tno>H2:tnn:oMT)  w<nH>rcScn 


LCC  vs  Cumulative  Probability  ( 'Jsing  Generated  LCC  Values) 
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Figure  5.  Cumulative  LCC  Probability  Curve  for  C-141A/B 

VSCF  Alternative 
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was  reduced  by  75  percent.  The  likelihood  of  either  or 
these  events  occurring  could  occur  appeared  remote. 

The  baseline  delta  between  the  two  alternatives  became 
even  larger  when  a  conservative  five  percent  inflation  rate 
and  the  current  accepted  Department  of  Defense  ( DOD )  dis¬ 
count  rate  of  10  percent  were  applied  to  the  life  cycle 
costs  of  both  alternatives.  With  both  of  these  factors 
calculated  into  the  study,  the  VSCF  ROI  became  .21  to  i. 

Finally,  by  performing  a  limited  risk,  analysis  using 
the  RISKMC  module  of  CASA,  the  researcher  found  VSCF  costs 
varying  between  3155  million  dollars  and  3190  million  dol¬ 
lars.  Additionally,  using  the  risk  analysis  parameters 
listed  m  Table  13.  the  RISKMC  estimated  that  there  was 
about  .95  probability  of  VSCF  costs  reaching  3185  million 
do  1 1 ars . 

Through  having  performed  the  initial  baseline  ccrnpuris 
on,  extensive  sensitivity  analysis,  and  a  limited  risk 
analysis,  the  quantitative  analysis  showed  that  under  a  wid 
variety  of  assumptions,  the  VSCF  did  not  prove  to  be  a  cost 
effective  option,  even  though  it  improved  reliability  by 
over  300  percent.  The  VSCF  system  may  indeed  provide  addi¬ 
tional  reliability,  but  the  extensive  quantitative  analysis 
performed  suggested  that  it  may  not  be  worth  the  large 
acquisition  cost. 


AN/ALR-46/69  Signal  Processor  Power  Supply 

Rational  For  Using  CASA .  As  mentioned  lici.  the 
additional  data  collection  effort  for  this  project  proved  to 
be  particularly  challenging.  As  the  AN/ALR-46/69  Radar 
Warning  Receiver  was  in  use  on  more  than  17  different  weapon 
systems,  subjecting  the  Signal  Processor  Power  Supply  to 
several  different  stress  levels,  only  two  analysis  opt  ions 
seemed  to  be  available: 

1.  Perform  separate  analysis  tor  each  weapon  system. 

2.  Formulate  a  methodology  to  aggregate  the  necessary 
reliability  and  maintainability  data  necessary  t_«*  provide 
representative  data  inputs  to  a  particular  model. 

The  difficulty  with  choosing  the  first  alternative  f t v 
the  AN/ALR-46/69  Signal  Processor  Power  Supply  prelect  was 
that  existing  Air'  Force  inventory  management  dnt  i  systems 
aggregate  the  only  information  available  concerning  mam 
tenance  repair  cycle  time,  mean  time  to  repair,  mean  time 
between  demand,  and  a  host  of  other  reliability  and  mam 
tainabi 1 i ty  information.  The  researcher  was  unable  to  t l na 
enough  distinct  data  to  perform  the  Cigna!  Processor  F  aw-  y 
Supply  analysis  for  each  separate  weapon  system. 

The  only  choice  left  to  the  researcher .  if  any  analysis 
was  to  be  accomplished,  was  to  aggregate  the  re  1  lab : 1 : ty  and 
ma intainabi 1 ity  data.  A  methodology  was  formulated  to 
successfully  accomplish  this  task  with  a  fair  amount  cr  ac 
curacy . 
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In  addition  to  the  desirable  reliability  ant  n.a 
ability  characteristics  mentioned  in  the  previous  C 
analysis.  CASA  was  chosen  as  the  model  to  use  for  th 
project  because  it  was  determined  that  this  mo.de  1  ha 
greatest  capability  to  handle  ^his  aggregated  data, 
tional  1 /  .  C/ASA  determines  average  number  of  opera t  in 
systems  per  location  by  dividing  the  total  number  of 
systems  using  this  system  by  the  number  of  operating 
tions.  While  this  method  of  determining  operating  s 
per  location  may  overestimate  or  underestimate  the  a 
number  of  operating  systems  at  any  given  location.  : 
greatly  facilitated  data  entry  and  was  acceptable  fa 
purposes  of  this  study. 

Analysis  Using  CASA .  As  with  the  previous  t 
projects,  the  AN/ALR-46/A9  project  data  analysis  wor 
provided  the  data  required  for  the  base  Line  analysis 
Appendices  J  and  I).  Table  14  illustrates  th-*  mill 
a n a i y sis  results.  It  re v e a  I s  t h a t  o p o r a 1 1 o n a  1  a n d 

cost  savings  ■:-i  the  improv^>^  c  f  r  b  -  Signal  I 

Power  bupp  .  y  to.  oe  b  —  Uc  v  .  o  mi  .  i  io  n  .le  i  i  irs  vei  fr.- 
per : od . 

As  with  the  C  141  V3CF  system  pro  )ect  .  the  TEN 3 
of  CASA  v/as  used  to.  perform  sensitivity  analysis 
Cost .  MTRF .  and  MTTR  for  each  alternative.  Additi-  n 


118 


Table  14 


Results  of  AN/ALR-46/69  Signal  Processor  Power  Supply  Baseline  Analysis 
COST  COMPARISON  (1985  DOLLARS  x  1000)  07-00-89 


TOTALS  OVER  ALL  YEARS  ••• 


Base :  Existing 

AN/ALR-46/69 

Power  Supply 

Alternative:  Improved 

AN/ALR-46/69 

Power  Supply 

Total 

Total 

Bale 

A1  ternative 

Di  f  f 

XDlf  f 

ACQUISITION  COSTS 

TOOLING  AND  T.E. 

.  0 

.  0 

.  0 

.  0 

START  UP 

.  0 

.  0 

.  0 

.  0 

SYSTEM  ACQUISITION 

.  0 

.  0 

.  0 

.  0 

SHIPPING  CONTAINERS 

.  0 

.  0 

.  0 

.  0 

PRE-PROD  ENG  CHANGES 

.  0 

300.0 

300 . 0 

.  0 

PRE-PROD  REFURBISH 

.  0 

.  0 

.  0 

.  0 

INSTALLATION 

.  0 

.  0 

.  0 

.  0 

SUPPORT  EQUIPMENT 

.  0 

.  0 

.  0 

.  0 

HARDWARE  SPARES 

145.6 

39.0 

-106.6 

-73.2 

SPARES  REUSABLE  CONT 

.  0 

.  0 

.  0 

.0 

INITIAL  TECH  DATA 

.0 

.  0 

.  0 

.  0 

INITIAL  TRAINING 

.  0 

.  0 

.  0 

.  0 

TRAINING  DEVICES 

.0 

.0 

.  0 

.  0 

NEW  FACILITIES 

.  0 

.  0 

.  0 

.  0 

INITIAL  ITEM  MGMT 

.  0 

.  0 

.  0 

0 

MI  SC  ACQ  COSTS 

.  0 

.  0 

.  0 

.  0 

WARRANTY 

.  0 

.  0 

.  0 

.  0 

TOTAL  ACQ  COST 

145.6 

339.0 

193.4 

132.8 

OPERATION  &  SUPPORT  COSTS 

OPERATION  LABOR 

.  0 

.  0 

.  0 

.  0 

REPAIR  LABOR 

1835  .  1 

72 . 9 

-  1762  .  2 

-96.0 

SUPPORT  EQUIP  MAINT 

.  0 

.  0 

.  0 

.  0 

RECURRING  TRAINING 

.  0 

.  0 

.  0 

.  0 

REPAIR  PARTS  AND  MTL 

276  .  4 

81.8 

-194.6 

-70.4 

CONSUMABLES 

2 . 8 

,  8 

-2.0 

-71.4 

CONDEMNATION  SPARES 

.  0 

.  0 

.  0 

.  0 

TECH  DATA  REVISIONS 

.  0 

.  0 

.  0 

0 

TRANSPORTATION 

144.6 

42 . 8 

-101.8 

-70 . 4 

RECURRING  FACILITIES 

.  0 

.  0 

.  0 

.  0 

RECURRING  ITEM  MGMT 

.  0 

.  0 

.  0 

.  0 

CONTRACTOR  SERVICES 

.  0 

.  0 

.  0 

0 

ENGINEERING  CHANGES 

.  0 

.  0 

.  0 

0 

MISC  0  A  S  COSTS 

.  0 

.  0 

.  0 

.  0 

TOTAL  O&S  COST 

2258 . 9 

198.3 

-2060 . 6 

-91.2 

TOTAL  COST 

2404  .  5 

537 . 3 

-  1867  .  2 

-77.7 
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imilar  to  the  C-141A/B  VSCF  System  study,  this  sms  m 
na lysis  was  performed  m  two  separate  steps: 


1.  Performing  sensitivity  analysis  on  the  prop  is 
ower  supply  improvement  while  holding  the  LCC  or  the 
Misting  power  supply  at  the  baseline  results. 

2.  Keeping  the  LCC  total  of  the  proposed  power  s 
improvement  at  the  baseline  while  performing  sensitiv: 
no  lysis  of  the  existing  power  supply  alternative.  7a 
.nd  id  highlight  the  results  of  these  sensitivity  ana  1 
ensitivity  analysis  was  also  performed  or.  other  '/aria 
f  interest.  Table  17  shows  the  results  of  this  ana  1  v 


The  RI3KMC  module  was  used  to  perform  risk  anaiys 
total  life  cvcie  cost  nrofcabi 1  it ies  far  the  Imorov 


ignal  Proses 
he  parameter 


ne 


unit  cost 
. ed  from  i 


ercerit  cost 
onservat ive 


or  Fewer  Lupply  A  1 1  er  nat  ive  .  i  gD  :  a  l  *  /  r 
selected  for  unit  cost ,  MTBF.  a  nd  MTTF . 
of  the  improved  power  supply  alternative 
s  proposed  p rice  t o  a  v a  1 u e  r e p r e s e n 1 1 n g 
ncreasc.  The  MTBF  ranges  chosen  roprere 
st  imat.es  far  the  VSCF  alternative.  T7.ee 


•  mates  were  used  t-' 


3CF  MTBF 

wou  id 

be  sign.it  ic- 

ant ly  1 ower 

st i mated 

by  r  h  - 

e  VSCF  Pro je 

c  t  P  i  a  n  . 

a  1  u  e  w  a  s 

var  i  e 

:i  r  c,  captu r e 

up  to  a  _>0 

he  depot 

ma  inf' 

-nance  hours 

required  f 

ower  supply.  Since  the  probability'  d 


than  the  MTBF 
F  i  na  1  ly  .  the  MTT 
0  percent  mere  a 
•:>  repair  the  imp 
l  s t  r  i  but  i  /-n  ■:  r  t 
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Table  15 


Sensitivity  Analysis  Exarninma  LCC 

p  f 

rects  0 

L 

f  V, 

■a  r.  a 

T 

r. 

Improved  Power 

Supply  MTBF. 

MTTR. 

and 

M  *-.  ■*  1  " 

■-nil  t 

O 

.-3 

■ . 

W':  ‘i 

7 

1  e 

Ho  I d i ng 

Current  Power 

Sapp  ly 

LC 

<  '  ~  p|  C  | 

it 

r-- 

*- 

( m  thousands 

0  i  do  i 

lar 

_£■  J 

Percent 

Current 

Impro 

v  '71 

2  1  L  l 

X 

r. 

r,  r 

•-'I  * Z.  vV  i 

S  pwr  Sup 

Pwr  S 

.1  p 

■J  0  i 

1^- 

3 

:i  n  5 

Var i  ab  1  e  Base  I i r 

*=■  •  LCC  *  • 

7  '“V‘ 

P  e  r  c 

T 

P 

r  :• 

JT  £ 

MTBF  35 

i 2404 . 4 

5  1515 

.  3 

r  ...  p  p 

V 

2 

MTBF  50 

$2404.4 

$1065 

.  t 

$  - 1 3  :■ 

3 

*' 

-  5 

MT3F  75 

3  J  4  u  *4 . 4 

5  9  i  2 

ji 

5  14  9 

1 

6 

£ 

.  £  . 

MTBF  100 

3  J  4  0  4 . 4 

$837 

.  3 

$  -  i  5  6 

..  -6 

cr 

•  . _ _  a 

MTBF  150 

$2  104 . 4 

$7  59 

.  £ 

$-16  4 

5 

•  ■  8 

.  t 

MT3F  300 

$2404.4 

$684 

.  1 

5  - 1 7 .7 

3 

,  ..  ‘7 

C,  ... 

MTBF  5  G 

$2404 . 4 

$6  56 

: 

.  1 

5-174 

3 

j 

— 

MTBF  550 

$2404 . 4 

$648 

■ 

$  175 

r. 

-j 

.  Oh. 

MTTR  25 

$2404 . 4 

$782 

y 

$  -  1 6  2 

• 

- 

- 

1  ■. 

MTTP.  50 

$2404 . 4 

$800 

a 

$-  160 

3 

MTTR  75 

$2404 . 4 

$00  9 

.  i 

$  158 

5 

:  r 

5 

.  ■  - , 

MTTP.  100 

$2404 . 4 

$3  37 

$-156 

y 

; 

C 

MTTR  150 

$2404 . 4 

$  8  7  2; 

$  -  1  5  3 

- 

■7  j. 

MTTP:  300 

$2404  .  ; 

$98  3 

.  i 

.1-112 

1 

3 

.. .  F- 

0 

.  1 

M5TI-:  450 

$2404 . 4 

$  i  0  9  2 

,1 

.  “* 

$  131 

£ 

:  5 

• : 

.  rj 

MTTR  550 

'5  2404  .  -4 

$  1  i  6  5 

2 

•V  -  '  " 

0 

| 

~ 

IT:—  :.tr 

$  0404 . 4 

$  3  0  8 

1 

T  1  *4 

6 

3 

i  ■ 

:  \n  (T 

• J u  •  J 

$2404 . 4 

5  vo  i  / 

Q 

.  y.j 

$  -1 5  8 

r 

_  1 

r  [p  "? er 

$2404.4 

•  r  p  y 

.  6 

$-157 

‘j 

8 

■  0 

— 

tie  100 

$2404 . 4 

$8  37 

“j 

$  -  1  5 1 

-? 

1 

1  ■  - 

r 

ijr  j.5,3 

$  0404 . 4 

■lu  r, 

_■ 

$  1  5  4 

'  ? 

6 

\ 

:i  2 

!JC  300 

$2404 . 4 

'1 '  ■'  i  ~ 

■r  ;  _i ; . 

1 

; 

:  •-*'  iP'r, 

^  V.‘ 

$240  1 . 4 

i;  ■' 

.  3 

$  14  : 

- 

:  ■- 

r  : 

J  ■-  J  73  'J 

$2404 . 4 

,  t*  *  ,  ■ ,  •’  ~l 

v 

$  -1  39 

1 

tj 

! 
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Table  16 


Sensitivity  Analysis  Examining  LCC  Effects  of  Cnanging 
Existing  Powe^  Supply  MT3F .  MTTR.  and  Unit  Costs  While 
Holding  Improved  Power  Supply  LCC  Co  istant 
(in  thousands  of  dollars) 
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Table  17 


Results  of  AN/ALR-46/69  Gignal  Processor  Power  Supply 
Sensitivity  Analysis  for  Selected  Variables 
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proposed  data  was  unknown,  as  with  the  ('-111  VSCF  ana  lye 
the  researcher  chose  to  use  the  uniform  distribution . 

The  maximum  number  of  iterati  .-ns  •  100U  ••  was  a  i  s  ■■  'k 
far  the  AN  •''A.LR-46/ 69  Improved  Tower  Supply  Mo-r.t •=•  Car  hi 
Simulation.  The  maximum  number  of  iterations  were  used  i 
effort  to  add  statistical  significance  to  the  use  of  the 
■uniform  distribution.  Figure  6  shows  the  results  .f  the 
risk  analysis  for  the  improved  power  supply  alternative. 


LCC  vs  Cumulative  Probability  (Using  Generated  LCC  Values) 


800  850  900  950  1000  1050  1100  1150  1200  1250  1300 


800  850  900  950  1000  1050  1100  1150  1200  1250  1300 

Life  Cycle  Cost  (x  $1000  dollars) 


Figure  6.  Cumulative  LCC  Probability  Curve  for  AN/ALR-46/c 9 
Improved  Signal  Processor  Power  Supply  Alternative 
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F i rulings .  The  initial  analysis  showed  that  the  total 
LCC  difference  between  the  two  alternatives  was  about  $  1 .56 
million  dollars,  with  the  improved  power  supply  alternative 
being  the  less  costly  alternative.  Additionally,  the  opera 
tional  and  support  cost  savings  of  the  proposed  power  suppl 
improvement  was  about  $2.06  million  dollars.  With  the  crip 
inai  $300  thousand  dollar  investment  cost,  this  represent -d 
a  ROI  of  about  6.87  to  1.  However .  with  the  increase  i  r. 
project  investment  costs  of  an  additional  $300  thousand 
dollars,  the  ROI  decreased  to  about  3. -4 3  to  1. 

This  original  return  on  investment  closely  mirrored  *  h 
6.95  to  1  ROI  estimated  by  the  original  PRAM  Project  T 1  » n . 
This  seems  to  strongly  collaborate  the  original  study 
performed  by  the  PRAM  staff.  This  was  because  the  M73F 
values  used  in  the  two  studies  were  significantly  different 
The  MT3F  used  m  the  original  study  was  loot  hears,  versus 
2960  hours  used  for  the  quantitative  analiAf  is  using  CAT  A . 
The  value  of  2960  hours  was  used  because  it  more  accurately 
estimated  the  MTBF  of  the  Signal  Processor  Pow-'i  Supply 
across  the  different  using  weapons  systems  >  see  page  '6  •> 

for  an  explanation  of  the  data  aggregation  process).  Had 
the  model  used  the  1950  MTBF  value,  the  cost  savings  would 
have  exceeded  $3.2  million  dollars,  representing  a  ROI  of 
over  10.6  to  I  if  only  $300  thousand  do  liars  was  used  as  in 
investment  cost  or  about  5.-4  to  1  using  a  $600  thousand 
dollar  investment  cost. 
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In  addition  to  the  baseline  analysis,  the  extensive 
sensitivity  analysis  performed  showed  that  the  improved 
power  supply  alternative  proved  to  be  the  more  feasible  co 
alternative  for  a  wide  range  of  critical  variable  values 
(see  Tables  15-17).  As  Table  16  highlights,  the  current 
power  supply  would  be  the  more  viable  alternative  only  if 
the  MTBF  of  the  existing  power  supply  had  been  underest  una 
ed  by  several  thousand  hours. 

The  limited  risk  analysis  performed  showed  that  total 
LCC  for  the  improved  power  supply  alternative  could  be 
expected  to  range  between  $850  thousand  and  about  $1,225 
million  dollars.  Using  the  95  percent  probability  figure 
$1.2  million  dollars  to  represent  a  conservative  LCC 
estimate,  the  operational  and  support  cost  savings  would 
still  amount  to  about  $1.6  million  dollars.  This  would 
still  demonstrate  a  positive  ROI  of  about  2.67  to  1.  if  *  h 
$60C  thousand  dollar'  figure  was  used  as  the  baseline  proje 
development  cost. 

Limitations  of  CASA.  While  CASA  proved  to  be  quite 
flexible  for  performing  the  trade  off  analyses  for  both  f h 
C-141A/B  VSCF  System  and  the  AN/ALR -46/69  Signal  Processor 
Power  Supply,  it  had  some  limitations  which  impacted  the 
overall  analysis.  As  with  3ILCC.  CASA  used  formulas 
designed  to  calculate  optimal  spares  provisioning  for  each 
alternative,  rather  than  actual  spares  provisioning.  This 
may  have  caused  both  studies  to  underestimate  the  aequisi- 


tion  costs  of  spares  for  each  alternative  in  both  the 
C-141A/B  VSCF  System  analysis  as  well  as  the  AN/ALR-46/69 
Signal  Processor  Power  Supply  analysis.  However,  with  the 
flexibility  that  CASA  has  to  include  both  miscellaneous 
acquisition  and  ^jsus.  cues-  categories  could  no  uscu  t 

reflect  a  wide  variety  of  spares  provisioning  policies. 

Even  using  these  categories,  there  still  is  a  high  probat i 1 
ity  that  CASA  would  inaccurately  calculate  spares  provision 
ing . 

The  other  challenge  to  using  CASA  was  to  determine  the 
proper  system  monthly  operating  hours.  In  the  C-141A/B  VSC 
analysis,  the  system  operating  hours  of  both  the  VSCF  and 
the  CSD  mirrored  the  weapon  system  flying  hours.  However, 
with  the  MTBF  calculations  for  the  AM/ALP  46/69  Signal 
Processor  Power  Supply  being  calculated  as  a  fraction  of 
weapon  system  operating  hours,  the  actual  system  hours  to 
use  for  the  monthly  system  operating  hours  input  became 
somewhat  muddled.  The  researcher  decided  to  use  weapon 
system  operating  hours  for  the  baseline  analysis,  but  a  lum¬ 
per  formed  a  comparison  analysis  using  the  fractional  "a; 
dilation  as  well.  As  could  be  expected,  the  fractional  -,.4 
value  resulted  in  a  lower  operational  and  support  cost 
savings  (31.32  million  dollars  using  the  fractional  value 
versus  32.06  million  dollars  using  the  full  weapon  system 
operating  hours).  However,  even  using  this  lower  fraot ion a 
value,  the  ROI  was  still  about  2.2  to  1. 


Two  other  CASA  limitations,  while  not  seriously  hinder¬ 
ing  the  analyses  undertaken,  nevertheless  should  be  men¬ 
tioned.  since  they  did  slow  down  the  overall  pace  of  the 
analysis.  Although  the  actual  CASA  software  was  easy  to  use 
ai  iu  jji  o/idfiu  li  large  amount  oi  line  i.eip.  cne  vA_<A  usoi  s 
manual  was  difficult  to  use.  The  explanation  of  how  dif¬ 
ferent  formulas  were  used  in  various  CASA  calculations  was 
difficult  to  follow.  Many  hours  were  spent  reviewing  in- 
user's  manual  and  several  program  runs  were  needed  by  the 
researcher  to  learn  how  the  various  formulas  were  integrated 
into  various  CASA  models.  Additionally,  as  opposed  to 
5ILCC.  CASA  documentation  did  not  provide  any  guidance  about 
where  to  locate  data  needed  for  model  use.  While  admittedly 
it  is  infeasible  for  a  POD  developed  model  to  even  broach 
this  issue,  without  any  guidance  provided  about  where  to 
gather  the  data  needed  for  model  inputs,  the  use  of  the 
model  to  perform  quantitative  analysis  becomes  much  mere 
difficult. 

SIDAC  Analysis  Assistance 

During  the  initial  phases  of  this  study,  the  author 
used  the  Support abi 1 lty  Investment  Decision  Analysis  Center 
(SIDAC)  model  catalog  as  a  resource  for  assistance  in  deter¬ 
mining  which  models  to  use  for  the  study  and  where  to  locate 
data  sources  needed  model  inputs.  Several  people  from 

Corporation,  who  are  members  of  the  SI  DA;" 
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concept  exploration  team,  also  offered  some  general  assis¬ 
tance  in  locating  data  sources,  determining  model  util; ty . 
and  obtaining  some  model  software. 

The  SIDAC  model  and  data  catalogs  did  provide  the  re- 

5oui  *  wi  wu  eo.  .j uQi  v_  a.  pc  * ut  r c i"  o it  3 i -T*  1  1  y' 3  1  C  .  V7 Z.  *"  . . 

the  data  catalog  providing  the  most  assistance.  The  data 
catalog  provided  the  researcher  with  functional  descriptions 
of  several  existing  Air  Force  data  systems  along  with  the 
office  of  primary  responsibility  and  point  of  contact .  The 
model  catalog  was  more  i  united  in  its  utility,  however . 

While  it  did  provide  a  general  description  of  almost  all 
models  surveyed  in  this  study,  the  only  model  that  was 
described  with  enough  detail  to  make  a  utilization  decision 
was  LAMP/ LAWS  and  SCOPE-MOD  ! -Id :  12-44 . 58- 60 )  .  The  d u -  union  ■ 
tat  ion  on  all  other  models  had  to  be  obtained  from  the 
office  of  primary  respons  i  b  i  1 1  ty  before  the  resear.. 'her  was 
able  to  obtain  enough  information  as  to  model  use. 

However,  as  the  SIDAC  was  still  undergoing  concept  ex¬ 
ploration  during  the  research  period  of  this  study,  its  con¬ 
cept  exploration  team  members  were  not  ram: liar  orm ugh  w :  -  ii 
any  models  used  in  this  analysis  to  provide  the  author  with 
any  assistance  regarding  their  capabilities  or  1 lmi tat  ions . 
Additionally,  while  the  model  catalog  provided  an  important 
starting  point  for  the  model  investigation  phase  of  this 
research,  it  was  only  in  dr a 1 1  form  when  used  by  the  author. 
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V.  Conclusions  And  Rec  ammendoj:  z  g  r. 

Review 

The  purpose  of  this  research  wa  s  to  deter 
use  of  existing  microcomputer-based  logistics 
could  improve  the  evaluation  and  validation  of 
ability  assessment  for  ma  3 or  PRAM  proposals . 
that  microcomputer -based  logistical  support  mo 
matured  enough  witinn  the  Air  For-e  supper  tab  i 
to  conduct  valid  research  into  this  area.  Add 
research  sought  to  determine  the  validity  of  u 
tail o r e d  a p p r o a c h  id e n 1 1  f y :  n g  t he  benefits  a n 
c  f  s  u  o  h  a  n  a  p  p  r  o  a  c  h  . 

One  of  the  necessary  steps  in  conducting 
was  examining  the  existing  quai itat ive  analysi 
then  attempting  to  adapt  or  modi ry  that  pieces 


quant  1  tat  1 ve 

appro 

ach  that  wcu  1  d 

Tew  logistics 

models  to  be 

used . 

The  research 

a c c cm pi  1 s h e d  t h 

not  without  .overcoming  significant  challenges 
d e sen b e d  in  3 u fc s e <  1  u e n t  :  1  e ct  1  o ns  of  t h 1 3  c h a t 
It  is  important  to  reaim  float  the  nse a 
only  those  areas  of  the  PRAM  decision  mating  p 
could  be  quantified.  Before  the  reader  assume 
author  is  advocating  the  use  of  models  to  quan 
entire  PRAM  project  decision  pr  '-cess .  it  shou: 
phasiz^d  that  the  research  focused  only  on  hew 
legist ics  support  models  could  improve  the  cos 


analysis.  Some  of  the  key  variables  that  must  be  consider*: 
in  the  complete  analysis  and  decisions  for  any  PRAM  pro ;  •••'’ 
were,  and  may  always  be.  qualitative  in  nature.  Key  deci¬ 
sion  variables  such  as  the  technical  risk  of  the  project  a: 
the  level  of  CPO/SPM/MAJCOM  commitment  are  often  subject:'. 
and  may  prove  di f f i cul t ,  if  not  lmooss 1 b i e .  t o  quant : fy . 


k  e  s  e  o.  r  c  h  P  e  s  u  i  t  s 

The  tailored  methodology  used  in  this  research  allow 
the  researcher  to  adequately  perform  the  quantitative  cos 
benefit  analysis  for  each  of  the  PRAM  projects  used  in  t h 
thesis.  However,  since  each  phase  of  the  research  provid 
the  author  with  interesting  and  sometimes  difficult  chal¬ 
lenges.  per na pc  the  best  way  to  discuss  the  research  re  cu 
is  to  highlight  the  results  as  thev  occurred,  bv  -examinin' 


1.  decision  level  analysis: 

2.  initial  mode  1  survey  and  data  collection 

3 .  f i na 1  mode i  select l on : 


4 .  mode i  use  i n  pei  formi ng  quant 1 1 a t ; ve  a na 1 ys i s : 

5.  SIDAC  analysis  assistance . 

De  ;  :  s  i  on  Le  ve  1  Ana  1  vs :  s  .  Performing  decision  1  eve 
analysis  proved  to  be  the  cornerstone  to  the  success fu : 
application  of  the  t.ai  lored  methodology.  Without  know  i : 


how  the  PRAM  decision  pr 


worked .  as  well  as  the 


measures  of  merit  that  individual  PRAM  or 'grim  man  a 


1  J  1 


senior  PRAM  management  were  using  to  evaluate  each  pro 
it  would  net  have  been  possible  to  select  the  proper 
supportabi 1 lty  model. 

As  stated  in  chapters  3  and  4.  determining  the  level 
analysis  required  two  steps: 

1.  determining  the  decision  orientation's); 

2.  evaluating  the  amount  of  data  available. 

This  process  was  relatively  uncomp  1  i cated  .  The  ir.-  io-pth 
evaluation  of  each  PRAM  Project  Plan  and  unstructured  ir.t 
views  with  each  respective  Project  Manager,  together  with 
follow-on  conversations  with  senior  PRAM  management,  tool 
the  author  about  two  weeks. 

Although  this  procedure  was  uncomp  1 1 cared .  ty  deter¬ 
mining  the  decision  or  lentut  ior-is  i  re  paired  and  the  da-  u 
available  for  each  project,  it  was  possible  to  develop  a 
matrix  of  analysis  complexity  to  ass  i  st  n»  the  mod-' 1  se ;  e 
t ion .  The  use  of  this  mati  ix  greatly  facilitated  search: 
for  and  s  e  1  e  c  r.  l  ng  a  n  a  p  p  r  o  p  r  :  a  f  -  mod  -  1  . 

Initial  Model  Guryev  arid  Da  ta  Collect  i  on  .  TV;  e  p  r  o  c  e 
cf  finding  microcomputer  based  logist  ics  support  irrd  ;•  1  r 
would  match  the  level  of  analysis  required  for  each  PRAM 
project  proved  to  be  a  challenging  task .  Since  none  of  * 
managers  of  the  PRAM  projects  studied  had  any  expo-r  ier.c-.' 

use  of  mi ci  o  computer  mo-dels  .  the  researcher  ha  1 


with  the 


rely  on  3 ever, 


1  u  3  3  i  .L  e  _t  a  e  1 1 


searcn  process. 

The  initial  model  survey  was  conducted 
Logi sties  Service  Information  Exchange  ( DL3 
logistics  support  model  catalogs .  However, 
motion  both  these  model  catalogs  provided  v 


or :mur 

did  provi  .ie  an  imo  a  t  an* 


.'ir'.e!  '-lie 


tne 


tne  dec i si  ••n  ir 


model  helped  to  drastically  reduce  the  numb 
mode  1 s . 

The  most  important  sources  -T  mtuiua' 
potentially  useful  supper*- ah  1  1  lty  models  tu 
t  ne  Ar  i  i  .  e nt er  o  f  n. x  c e  .  1  ence  f  j 0  s  j  i  i  an  ill 
as  well  as  other  AFIT  professors  familiar  w 
ability  models.  If  was  through  the  assista 
associated  with  this  agervy  “hut  the  author 
t  he  o a n> i  1  a  f  -  rn '  < : e  1  s  1  ‘  wn  ■  ■  •  a  w- •. 
Nine  of  the  assistance  provided .  hovev 


r.  1  r  r 


i  &  r i  i  '  p,  y 


;sess  >'1  ny  c-ioob;  i:.ies  of  tn 


the  decision  orientation  or  the  model. 


a n  under 3 ta nd  1 1  ig 


:  ■  c.jpa 


•and  1  date  models,  it  was  rv'.-escarv 
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the  candidate  models.  Only  alter  a  brief  review  of  th* 
model  docimentaf i on  was  the  researcher  able  to  per  r  on 
initial  capability  assessment  of  each  candidate  movie  1. 

Data  Collection.  As  previously  stated,  during  th- 
initial  model  survey .  the  researcher  quickly  determine-.: 
data  existing  on  each  of  the  PRAM  projects  would  not  pi 
adequate  for  candidate  mode  1  use .  At  this  point,  a  ma . 
a d  d 1 1 1 o n a i  a a t  a  c  o i i e  c  1 1 o  u  effort  w  a  s  r e j  u ire  c . 

The  development,  of  a  fairly  standard  data  collect' 
worksheet  proved  to  be  instrumental  in  allowing  the  re;: 
to  continue.  Very  little  additional  data  was  nee  led  o: 
data  was  collected  using  the  standard  data  elements  1  ir¬ 
on  the  wor k s h e e  t . 


The  Cl DAT  data  catalog  pr 


in  tracking  down  sources  of  data  aval  lable  for  ea -h  cr  :• 
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t ion  personnel,  the  sources  of  most  of  the  additional  1 
were  identified. 

The  quality  and  accuracy  or  both  "he  original  PRAM 


and  the  additional  data  collected  proved 
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F-I5C/D  Improved  Aircraft  Wheel  analysis  and  th 
AN/ALR  -4,?/6^  Signal  Processor  Power  Supply  anal 
the  F-15C/D  I  nan  roved  Aircraft  Wheel  Project  .  t  r. 


:  he red  from  MODAS  .  "he  D':41  data 


the  Landing  Gear  Item  Manager's  office  wex  e 
si stent .  Unfortunately,  these  were  the  on i; 
nrcje't  I  :0:1st : . is  super,  rt  data.  The  tenhat 
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or  abandoned  before  the  process  of  data  aggregation  was  con: 
p 1 eted . 

Another  factor  that  had  considerable  bearing  on  data 
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not  as  severe  for  the  C-141A/B  V3CF  System  as  they  wei  e 
the  two  other  projects  was  due  to  the  efforts  t alter.  ::y  a 
member  of  the  PRAM  staff  to  ensure  that  the  data  used  in 
PRAM  analysis  f or  the  C-141A/E  V3CF  System  came  from 
credible  sources.  Original  PRAM  data  collection  -free 
were  not  quite  as  met i :u 1  out  for  the  other  two  projects . 

Final  Model  Reliction.  The  data  accuracy  pr:bl:-n.s 
countered  lead  the  researcher  to  choose  the  senoit  '.•••:  "y 
analysis  capabilities  of  the  various  candidate  nod  :•  i  s  as 
key  factor  in  final  model  selection.  it  became  extremal 
important  that  any  models  selected  for  use  be  capable  c 
prodding  the  researcher  with  the  capability  t,  per  rum 
sensitivity  analyses  on  key  d'-cision  variables. 

The  two.  rne.de  1  s  used  f'-t  c  induct  i  ng  the  pro  ;oot  c.  h. 
ysis.  STLCC  and  CARA,  hr  th  provided  these  extens ive  sen  • 


s  1 1 1  o'  1 1  v  a  n  a  i  v  s  \  s  c  a  d  a  n  i 


sensitivity  analysis  capabilities  e::li  i  b  1 1  e  1  by  bo.th  m  : 
each  had  unique  capabilities  that  furtfo-i  unpins. C  -d  :  : 

data  uncertainties.  3ILCC  has  a  feature  t  hut  rank  -  u 


1  ib  i  u  i  /  l 
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the  most  critical  variables,  allowing  the  bulk  of  the  ana 
ysls  to  be  focused  on  those  variables.  CASA,  while  not 
providing  the  rank-ordering  feature  found  in  3'ILC'C.  allow- 
the  researcher  to  accomplish  risk  analyses  as  well  as  sen 
sitivity  analyses.  These  features  mitigated  t h-.-  efforts 
da t a  u ncert a i ntv . 


I n  a d < i  no n  t o  t h e 
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ities  demonstrated  by  bath  SILCC  and  CATA.  these  row 
captured  other  features  needed  for  providing  "he  re 
analysis.  They  both  provided  good  matches  t'  the  r 
analysis  required  for  the  various  projects.  Add  if:  a: 
they  both  had  user-friendly  feature.-  which  greatly 
fated  data  entry  and  rnod^l  use.  They  also,  previni 
l  ities  to  perform  quick  on- line  variable  comparison.: 
a  1 1  e  r  n  a  fives  ,  a  f  e  a  t  u  t  e  t  h  a  a  s  i  g  r;  i  f  :  u  a  n  t  1  v  i  -  a  •]•-  i  . 


t  ime  . 


Cry  Models  t  ■  >  Per  form  Ouant  i  f  at  ive 


f  microcomputer  models  to  ter form  quant i i at i ve 


nevnusiv  aval  i  .dole  to  the  PRAM 


s  pro  vi  uea  a< 


b  e  r,e  t  1 1  analysis  f  o  i  e  a f~*  r.  p  r  o  i  e  c  f  .  *  n ' :i  i  i  ’  i  o  -  w  ■  ,i  s 


some  limitations  that  at  f  era  ed  t.h 
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mu  lysis.  This  so  ;t  ion  will  di  souse  the  b-r.ur 
doe  models  firs':  and  fh-.-n  discuss  their  1  :  m ;  • 
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Tab!  e 


Comparison  of  ROI  Calculation: 


Pro  iect 


PRAM  Project 
Plan  ROI 


Mode  1  1  nc 
ROI 


F-15C/D  Improved 
Aircraft  Whee1 


p.  - i 


C-14IA/B  VSCF 
System 


5 i  to  1 


.38  to  i 


AN  /ALR--46/69 
S  i  g  n  a  1  P  r  o  c  e  s  s  o  r 
Power  Supply 


6 . 93  to  1 


6 . 87  to  I 


Benefits  of  Mi croccmpur er  based  Legist ;cs  Mvde 
The  us°  of  these  microcomputer  • based  logistics  suppe.ro 
mode  i 2  to  perform  cost/benefit  analysis  pv  ovided  s|§n>- 
tant  enhancements  to  the  cos t/ bone f i t  analysis  ror  eaci 
project  m  this  study.  The  us-a  of  these  mi  ryr. a-vmput  er 
m< dels  require d  t  h e  r  o s e a r  d.er  t . c  . p t u r  c-  s  i  g r.  i  f  i  a n  t  1 
greater  amounts  of  data  for  each  :.f  the  three  projects 
was  aval  la  Me*  m  the  or  :u  i  nu  1  PRAM  dr.  cumenes.  This  i  ••• 


in  more  de tailed  assessments  <:•  f  the  no 


••r  ig  inu  l  PRAM  Pr  •-  vet  Plans.  Add  1 t  :  n 


i  ■  a  -a  ■_  ■■  « < 


“  hr  pro  i  icf  ?  .  t  he  1  nek 


data  caused  the  original  PRAM  staff  ana  1  ysf  .»s 

the  nro'ject's  estimated  retui  n  on  investment.  A I  *  he.’. i 


d ro  iect  c o s t s  we r 


v-rest  i mated  in  t 


v#  L  i  i  : 


a  nu  1  you.  t  .  the  mode  [  mg  analysis  <:o  i  1  nb-'.i  it 


basic  recommendations  of  the  original  PRAM  Project  Plan 


analysis.  Quantitative  analysis  using  the  selected,  mode 
resulted  in  overall  positive  ROIs  for  the  two  projects 
originally  having  positive  ROIs  in  the  PRAM  project  Plan 
Additionally,  the  only  project  having  an  unfavorable  ROI 
the  original  PRAM  Project  Plan  also  resulted  in  a  unfavo 
able  RO I  f r om  the  mod e 1 1 ng  anal y s i s . 

More  important  than  the  bottom  line  ROI.  however .  i 
the  magnitude  of  the  differences.  While  the  use  -  f  mod--  i 


did  not  refute  any  of  the  original  analyses,  for  those 
projects  that  originally  might  have  marginally  favorable 
unfavorable  HOls.  one  mignt  infer  that  use  of  modeling  m 
result  in  different  investment  decisions  than  those  resu 
ing  from  the  use  of  qualitative  techniques  alone .  S’  ro¬ 
of  the  projects  had  marginal  ROIs  -these  close  to  a  1  to 
ratio),  more  research  would  have  to  be  done  in  tins  area 
before  being  able  to  make  any  definitive  claims,  however 
Several  reasons  can  be  suggested  for  the  different'3 
the  original  PRAM  Project  Plan  and  the  modeling  RO I ' s . 


First,  the  original  analysis  mused  cn  only  a  p.„*rt  ior.  . 
the  relevant  data  available  to  perform  the  proper  trade 
analyses.  Many  important  data  elements  were  either  left 
of  these  original  analyses  or.  as  in  the  case  or  the  AN 
46/ to  Signal  Processor  Power  Supply  Analysis,  were  mco:n 
piete.  Second,  both  models  used  m  this  studs/  utilised 
optimal  spares  provisioning  formulas  m  the  quant itat ive 
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analysis,  whereas  all  three  PRAM  analyses  used  the  actus 
known  maintenance  spares  figures  from  the  various  depots 
The  actual  depot  spares  for  all  three  projects  was  signi 
cantly  higher  than  the  optimal  spares  calculated  by  the 
models  (by  greater  than  5  to  1  for  all  three  projects) . 
However,  while  this  may  be  a  problem  for  comparing  alter 
five  spares  costs  for  components  that  have  not  been 
procured,  in  all  three  of  the  projects  analyzed,  all  nec 
sary  spares  had  been  procured  for  the  existing  aiternati 
The  use  of  spares  provisioning  costs  m  ROI  calculations 
would  have  overinflated  the  ROI  of  the  proposed  improve¬ 
ments.  Moreover ,  the  use  of  spares  cost  in  the  cost/ben 
calculations  when  they  have  become  sunk  costs  tor  the 
existing  alternatives  would  result  in  incorrect  analysis 
The  use  that  both  models  made  of  optimal  spares  provicr 
formulas  significantly  reduced  the  number  of  scares  used 
all  LCC  calculations,  therefore  reflecting  a  more  thorou 
ana  T/si s  . 

Besides  the  more  thorough  analysis  capabilities  off 
by  the  models,  they  offered  the  ability  to  perform  rapid 
sensitivity  analyses  of  several  critical  variables .  Ac 
such,  once  the  data  had  been  entered  and  the  baseline  an 
ysis  performed,  it  was  a  relatively  uncomp  1  l car.ed  tack  t 
analyze  the  effects  of  changes  In  critical  variable  viiu 
on  overall  L'l'C  costs  and  project  ROIs.  These  sens  it  iv  it 
features  allowed  the  researcher  t  a  determine  at  wh..it  va  i 
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of  unit  cost.  MT3F .  MTTR .  etc.,  the  proposals  became  eithe 
favorable  or  unfavorable  relative  to  the  existing  alterna¬ 
tives.  Once  the  baseline  analysis  had  been  performed,  mos 
of  the  sensitivity  analyses  could  be  performed  in  less  tha 
20  minutes.  Without  the  use  of  microcomputer-based  models 
to  perform  the  sensitivity  analyses,  the  time  required  f  :• 
perform  such  comparisons  would  have  substantially  increase 

Another  benefit  of  using  one  of  the  microcomputer 
models,  was  the  ability  to  accomplish  quantitative  risk 
analysis.  While  the  risk  analysis  performed  in  this  re¬ 
search  was  quite  limited  in  scope,  any  number  of  values  nr. 
probability  distributions  could  be  used  to  quant i rat ive iy 
e:*:  ami  re  the  economic  risks  of  the  projects  ana  lysed  with. 
CASA .  The  capability  to  perform  this  type  of  risk  anulysi 
does  not  currently  exist  within  PRAM. 

Limitations  of  Microcomputer  Model  Whole  *he 

models  used  added  significant  value  in  performing  trv-  -c.r 
benefit  analysis,  they  were  not  without  limitations.  Cmc 
the  specific  1 imitat ions  of  each  mode  I  have  already  been 
addressed,  this  sect  ion  will  describe  the  i  imitat  rr:s  and 
restrictions  of  mode  1  use  as  they  generally  apply  to  the 
CRAM  program  ■office  and  its  stuff. 

P r o pe r  qu a ntitati v e  a na lysis  c o u Id  n o t  h a v e  b e e n  r  ' r  - 
formed  without  a  thorough  understanding  of  how  both  models 
functioned.  This  required  the  researcher  to  become  iam: 1 l 
with  not  only  data  required  for  model  use  and  the  over a  1 1 
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model  structure,  but  in  some  cases,  required  an  understand 
ing  of  how  various  mathematical  and  statistical  formulas 
were  used  in  performing  various  ca 1 culat ions .  While  this 
was  a  very  time  intensive  process,  without  a  thorough  unde 
standing  of  the  models,  they  may  have  been  improperly  used 
The  amount  of  time  needed  to  learn  how  a  single  model 
operates  was  very  time  intensive.  Additional ly .  while  the 
use  of  a  tailored  methodology  proved  essential  for  this 
project,  it  also  meant  that  the  researcher  was  required  to 
become  familiar  with  the  documentation  and  operation  of 
several  models.  While  this  proved  feasible  in  a  research 
environment,  the  us°  of  a  tailored  modeling  methodology  ran 
prove  to  be  impractical  without  use  of  full  time  analysts. 
The  primary  goal  of  PRAM  program  managers  is  to  provide 
overall  management  of  their  assigned  programs  and  protects 
The  performance  of  economic  cost/benefit  analysis  of  the 
project  is  only  one  of  the  many  competing  tasks  they  are 
required  to  per f  arm  in  the  project  management  process. 
Additionally,  at  any  given  time,  a  single  PRAM  Program 
Manager  mu/  be  responsible  for  the  management  of  as  many  a 
15  to  20  projects  i 2).  Given  these  parameters,  the  amount 
of  time  a  PRAM  program  manager  would  have  to  devote  to 
learning  how  to  use  even  a  single  model  may  be  quite 
limited.  However .  this  limitation  reinforces  the  need  for 
full  time  analysis  capability  such  as  the  Support ahi i if  y 
Investment  Decision  Analysis  Tenter . 


SIDAC  Analysis  Assistance.  While  the  analysis  assis¬ 
tance  given  to  the  researcher  by  the  SIDAC  concept  explore 
tion  team  was  peripheral,  it  nevertheless  proved  to  be 
important.  It  provided  general  guidance  concerning  data 
sources  and  supper tabi 1 i ty  models  at  several  key  phases  of 
the  entire  research.  Without  using  the  draft  copies  of  fh- 
SIDAC  data  and  model  catalogs,  the  research  would  have  tak- 
much  longer  to  complete.  The  SIDAC  concept  exploration  v/m 
being  conducted  by  the  Eynarr.ics  Research  Corporation  ;  DRO  ; 
and  the  assistance  provided  by  many  of  their  personnel  in 
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Re  comine  nda  a  1  ons  for  Fur  thin  Research 

Though  faced  with  some  challenging  obstacles  during 
some  of  the  phases  of  this  research,  this  study  demons t r n 
she  value  of  using  mi  ere  ■-  irr.put  er  bar-  i  logistics  sr.ppo  r* 
models  to  perform  quantitative  analysis  her  the  PRAM  fro 
Office.  Add  1 1 1  ona  1  ly  .  it  supported  the  tailored  an  pi  "  a,-h 
per f -arming  such  analysis.  Indeed,  if  ‘he  1  .? searcher  ha :: 
attempted  to  accompl  ish  this  research  using  only  •:  n  ■-  :m  -d 
meaningful  results  wo-uld  have  been  dirficult.  it  n-.-t  imp-: 
s  1  b  1  e  .  to-  •'  b t a  1  n  . 
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As  with  most  other  research,  however,  the  process  of 
obtaining  the  data,  performing  model  survey  and  selection, 
and  using  the  models  to  perform  different  levels  of  support 
ability  analysis  highlights  areas  in  which  improvements  are 
needed  and  follow  up  research  should  be  performed.  Eased  c 
the  analysis  and  findings  of  this  thesis,  the  following 
recommendations  should  be  considered: 

i.  Whi.e  AFLC  is  currently  taking  several  steps  t. 
modernise  their  reliability  and  maintainability  data  coiiec 
t ion  systems  through  the  Requirements  Data  Base  project.  Do 
data  accuracy  and  quality  were  problematic  for  this  re¬ 
search.  Possible  reasons  suggested  fir  R&M  data  accuracy 
problems  have  been  a  lack,  of  data  systems  input  editing 
integrity,  combined  with  lack  of  attention  to  data  entry  by 
f da  1 d  technicians.  Although  seme  work  has  been  done  in  tin 
area  to  cr,rvo,-*-  possible  causes  of  data  accuracy  problems, 
data  accuracy  issues  encountered  during  this  project  suggeo 
that  more  work  needs  to  be  accomplished,  especially  with 
efforts  that  focus  on  solutions  to  data  accuracy  problems . 
Any  research  in  this  area  should  also  include  an  ana  lye.  s  • 
the  difficulties  other  s u p p c rtabi 1 1 1 y  a n a  1 y s t s  h a v e  h a d  i n 
obtaining  quality  data  and  how  it  has  affected  their  -oral 


a  Ha  i  y  3 1?  S  . 

2.  The  PRAM  Program  Office  should  investigate  * 
Sibil  ity  of  developing  a  standard  p.  o  .oct  data  coll- 
worksheet .  such  as  that  which  ip pears  in  Appendix  A 
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cost /bens  fit  analysis  of  major  PRAM  pro  jecf.s  .  The  use 
such  project  worksheets  could  improve  the  thoroughness 
major  PRAM  project  analyses.  Any  worksheet  developed  s! 
allow  tor  flexibility  in  data  collection,  however .  sine 
data  requirements  may  vary  between  projects.  Never the’ 
these  p r o j e c t  d a t a  c o  1  1  e c 1 1  o n  wo r k sheets,  if  r. i •  o p e r  i y  1 1 
merited,  would  provide  the  PRAM  staff  with  roe  supror-  ■ 


a 1 1 1 1 1 v  i at  a  t h a n 


iroposa  l  s  . 


rurrer.tlv  rernc  receiver  tc  r  tna 


'3 .  The  PRAM  Program  Office  shoo  1  d  perform  an  is 
of  how  to  practically  mcoi  porate  the  use  of  a  tail*: 
modeling  approach  to  the  quant  i  t  .it  ive  cost /bene  f  :  -  a 
portions  if  major  PRAM  projects.  This  reseirch  demo; 
on  lv  the  feasibility  of  using  a  tailored  me  del  :r/r  vp 
t  o  p  e  r  f  o  r  m  p  r  eject  a  u  a  n  1 :  tat  i  v  e  cost,'  b  e  n  e  f  1 1  a  n  a  1  y  s  : . 
Although  if  discussed  some  of  ‘he  problems  or  mpl 
this  approach .  :t  was  not  designed  to  address  the  mo 


c h  1 1  ie n q e s  that  m a v  he 


±  ■  i  -  i  /  -  ■ 


:  n  approach .  If  would  be  very  appropriate,  h 


mentation  issues.  Specif  ical  lv.  if  senior  PRAM  mn  it 


rni  cr •■•computer  based  logiet  i  cs  n.-’-d- 


.■  rm  f  u  r  t  h  er  s  u  p  p  a  i  •  t  a  h  i  1  l  v  y  a  n 


V,  O  1  rri  *  1 


imp!  emer.f  their  use.  Imp  1  emer.tat  i-r.  sh  it 


iered  shot:  i  1  m-'inde 


a.  the  familiarization  and  training  of  PRAM  pr-v; 
managers  m  the  use  of  logistics  support  model  use: 

b.  the  development  of  an  in-house  supportab i  i  1  tv- 
ana  lysis  section  that  would  provide  the  capability  to  p# 
form  a  wide  variety  of  project  analysis; 

c.  the  use  of  other  Air  Force  or  contractor  sour 
such  as  the  SIDAC  to  perform  these  analyses: 

d.  some  combination  of  these  three  approaches . 

4.  Follow  up  research  should  be  conducted  info  th- 
feasibility  of  applying  the  tailored  modeling  method.:- lot 
for  other  logistics  support  agencies.  This  research  :  rd 
demonstrated  the  feasibility  of  using  this  t  a ;  1  : :  ~  i  a::p. 
in  the  PRAM  cost/benefit  analysis  process .  It  cor.  1  i  he 
safely  assumed  that  other  <  or  one :  es  within  the  .--upr  •  rt  d' 
C'.-rnmuni  ty .  such  as  system  prrorum  managers  and  item  :i»-a  :n : 
at  the  different  ALT  '  s  .  use  different  ieci.ci  an  t  r  •  c  . 


N e v e r  t  h e  1  e s s  .  f  u r  t  h a r  r-se a i  n  ma v  d e m-o n s "  r  a t « 


applying  this  same  process  to  -'.flier  areas  tf  t  h¬ 


a d 1 1 1 1 y  a ecisi o n  ma k i ng  p r o c ess . 


t  h e  eft  r  f  s  t f  u  1  y  i  mp  1  erne  n  t 
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Appendix  C:  C-141  VSCF  System  Project  Worksheet 
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Annual  Ops  Hrs  Annual  Ops 
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Appendix  D 


AN/ALR-46/69  Signal  Processor 
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Annual  Ops  Derived  Annual  Ops 
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Depot  Material  PRAM  Project  Depot  Material  PRAM  Project 

Costs _ $78 _ P^an _  Costs  $  10 _ Plan _ 

Number  Annual  Number  Annual 

Depot  Repairs  273  1XM 1  Depot  Repairs 


17:32:39  07-15-89 

Life  Cycle  Cost  Input  Paraaeter  Variables 

File  Naae:  2014alua 

Work  Unit  Code  Naae:  WHEEL, MLG 
Work  Unit  Code:  13AKB 
Manufacturer:  BENDIX 
National  Stock  Nuaber:  1630010585612 

Data  gathered  by:  CAPT  DAVID  MARTIN 
File  Tiae  and  Date:  11:33:13  06-23-89 


DEVC 

Developaent  Cost 

$ 

0. 

SYSI 

Systea  Investaent  Cost 

$ 

0. 

SEC 

Support  Equipaent  Cost 

% 

0. 

M 

Nuaber  of  Operating  Bases 

- 

11. 

AOH 

Average  Annual  Operating  Hours 

Hr 

115644.0 

POH 

Peak  Month  Operating  Hours 

Hr 

13467.0 

PI  UP 

Projected  Inventory  Usage  Period 

Yr 

20. 

UC 

Unit  Cost  of  I tea  As  a  Spare 

$ 

6780.00 

W 

Weight  of  I tea 

Lb 

160.60 

MTBD 

Mean  Tiae  Between  Deaand 

Hr 

2035.8 

MTBR 

Mean  Tiae  Between  Reaoval 

Hr 

668.0 

NRTS 

Fraction  of  Reaovals  Not  Reparable  at  Base 

- 

.090 

RTS 

Fraction  of  Reaovals  Reparable  at  Base 

- 

.910 

COND 

Fraction  of  Reaovals  Condeaned 

- 

.010 

PAMH 

Preparation  and  Access  Manhours 

Hr 

.50 

RMH 

Replaceaent  Manhours 

Hr 

8.40 

SMI 

Scheduled  Maintenance  Interval 

Hr 

.00 

SMH 

Scheduled  Maintenance  Manhours 

Hr 

.00 

BCMH 

Bench  Check  Manhours 

Hr 

.00 

BMH 

Base  Maintenance  Manhours 

Hr 

8.42 

BMC 

Base  Direct  Material  Cost/Failure 

t 

6.30 

BRCT 

Base  Repair  Cycle  Tiae 

Mo 

4.000 

DMH 

Depot  Maintenance  Manhours 

Hr 

12.00 

DMC 

Depot  Direct  Material  Cost/Failure 

t 

1375.48 

PA 

Nuaber  of  Reparable  I teas 

- 

1. 

PP 

Nuaber  of  Consuaable  I teas 

- 

49. 

PCB 

Nuaber  of  Consuaable  I teas  Stocked  at  Base 

- 

0. 

03T 

Order  and  Shipping  Tiae 

Mo 

.700 

DRCT 

Depot  Repair  Cycle  Tiae 

Mo 

1.800 

BLR 

Base  Labor  Rate/Manhour 

$ 

9.57 

DLR 

Depot  Labor  Rate/Manhour 

% 

21.46 

PSC 

Packing  and  Shipping  Cost/Pound 

* 

3.00 

SA 

Base  Inventory  Manageaent  Cost/I tea/Year 

% 

2.55 

IMC 

Initial  Inventory  Manageaent  Cost/Itea 

i 

.00 

RMC 

Recurring  Inventory  Manageaent  Cost/I tea/year 

* 

230.50 

17:36:12 


Life  Cycle  Cost  Input  Parameter  Variables 


07-15-89 


File  Name:  newrst 

Work  Unit  Code  Name:  WHEEL, MLG 
Work  Unit  Code:  NONE 

Manufacturer:  BENDIX  PROPOSAL 
National  Stock  Number:  NONE  AVAILABLE 

Data  gathered  by:  CAPT  DAVID  MARTIN 
File  Time  and  Date:  15:49:15  06-30-89 


DEVC 

Development  Cost 

% 

0. 

SYS  I 

System  Investment  Cost 

* 

846500. 

SEC 

Support  Equipment  Cost 

% 

0. 

M 

Number  of  Operating  Bases 

- 

11. 

AOH 

Average  Annual  Operating  Hours 

Hr 

115644.0 

POH 

Peak  Month  Operating  Hours 

Hr 

13467.0 

PIUP 

Projected  Inventory  Usage  Period 

Yr 

20. 

UC 

Unit  Cost  of  Itea  As  a  Spare 

% 

7800.00 

W 

Weight  of  Itea 

Lb 

160.60 

MTBD 

Mean  Time  Between  Demand 

Hr 

4071.0 

MTBR 

Mean  Tiae  Between  Removal 

Hr 

1002.0 

NRTS 

Fraction  of  Removals  Not  Reparable  at  Base 

- 

.090 

RTS 

Fraction  of  Removals  Reparable  at  Base 

- 

.910 

COND 

Fraction  of  Removals  Condemned 

- 

.010 

PAMH 

Preparation  and  Access  Manhours 

Hr 

.50 

RMH 

Replacement  Manhours 

Hr 

8.40 

SMI 

Scheduled  Maintenance  Interval 

Hr 

.00 

SMH 

Scheduled  Maintenance  Manhours 

Hr 

.00 

BCMH 

Bench  Check  Manhours 

Hr 

.00 

BMH 

Base  Maintenance  Manhours 

Hr 

8.42 

BMC 

Base  Direct  Material  Cost/Failure 

$ 

6.30 

BRCT 

Base  Repair  Cycle  Time 

Mo 

4.000 

DMH 

Depot  Maintenance  Manhours 

Hr 

12.00 

DMC 

Depot  Direct  Material  Cost/Failure 

S 

743.00 

PA 

Number  of  Reparable  I  terns 

- 

1. 

PP 

Number  of  Consumable  Items 

- 

49. 

PCB 

Number  of  Consumable  Items  Stocked  at  Base 

- 

0. 

OST 

Order  and  Shipping  Time 

Mo 

.700 

DRCT 

Deprt  Repair  Cycle  Time 

Mo 

1.800 

BLR 

Base  Labor  Rate/Manhour 

$ 

9.57 

DLR 

Depot  Labor  Rate/Manhour 

$ 

21.46 

PSC 

Packing  and  Shipping  Cost/Pound 

$ 

3.00 

SA 

Base  Inventory  Management  Cost/Item/Year 

1 

2.55 

IMC 

Initial  Inventory  Management  Cost/Item 

$ 

.00 

RMC 

Recurring  Inventory  Management  Cost/I  tem/year 

$ 

230.50 

Ranked  Sensitivity  Anal 


s  of  2014  Variables 


Appendix  G: 

17:53:28  07-15-89 

Life  Cycle  Cost  Sensitivity  Analysis 

File  Naae:  2014alua 

Work  Unit  Code  Naae:  WHEEL,MLG 
Work  Unit  Code:  13AKB 
Manufacturer:  BENDIX 
National  Stock  Nuaber:  1630010585612 

Data  gathered  by:  CAPT  DAVID  MARTIN 
File  Tiae  and  Date:  11:33:13  06-23-89 


Variables  Changed  by  Delta  =  .05 

Confidence  Level  of  Base  and  Depot  Spares  =  .95 


Rank 

Variable 

Original  Value 

Upper 

Lower 

Sensitivity 

1 

PIUP 

20.00 

21.00 

19.00 

142.286900 

2 

MTBR 

668.00 

701.40 

634.60 

139.014400 

3 

AOH 

115644.00 

121426.20 

109861.80 

138.677100 

4 

NRTS 

.70 

.74 

.66 

129.683400 

5 

PSC 

3.00 

3.15 

2.85 

68. 1S595C 

6 

W 

160.60 

168.63 

152.57 

68.165640 

7 

DMC 

1375.48 

1444.25 

1306.71 

50.943720 

8 

DLR 

21.46 

22.53 

20.39 

9.537850 

9 

DMH 

12.00 

12.60 

11.40 

9.537850 

10 

UC 

6780.00 

7119.00 

6441.00 

8.392208 

11 

BLR 

9.37 

10.05 

9.09 

5.785517 

12 

RMH 

8.40 

8.82 

7.98 

4.253409 

13 

COND 

.01 

.01 

.01 

4.144300 

14 

RMC 

230.50 

242.02 

218.98 

3.592797 

15 

PP 

49.00 

51.45 

46.55 

3.451903 

16 

M 

11.00 

11.55 

10.45 

3.436163 

17 

RTS 

.30 

.32 

.28 

1.378988 

18 

BMH 

8.42 

8.84 

8.00 

1.279048 

19 

POH 

13467.00 

14140.35 

12793.65 

1.036075 

20 

DRCT 

1.80 

1.89 

1.71 

1.036075 

21 

MTBD 

2035.80 

2137.59 

1934.01 

1.036075 

22 

PAMH 

.50 

.52 

.47 

.253212 

23 

BMC 

6.30 

6.62 

5.99 

.099940 

24 

PA 

1.00 

1.05 

.95 

.079005 

25 

SA 

2.55 

2.68 

2.42 

.017115 

26 

BCMH 

.00 

.00 

.00 

. 000000 

27 

PCB 

.00 

.00 

.00 

.000000 

28 

OST 

.70 

.74 

.66 

.000000 

29 

SYSI 

.00 

.00 

.00 

.000000 

30 

SEC 

.00 

.00 

.00 

.000000 

31 

BRCT 

4.00 

4.20 

3.80 

.000000 

32 

DEVC 

.00 

.OC 

.00 

.000000 

33 

SMI 

.00 

.00 

.00 

.000000 

34 

IMC 

rn 

♦  -/  v/ 

.00 

.00 

.000000 

35 

SMH 

.00 

.00 

.00 

.000000 

i 7 : 55:  10 


Life  Cycle  Cost  Sensitivity  Analysis 


07-15-89 


Pile  Naae:  newrat 

Work  Unit  Code  Naae:  WHEEL, MLG 
Work  Unit  Code:  NONE 

Manufacturer:  8ENDIX  PROPOSAL 
National  Stock  Nusber:  NONE  AVAILABLE 

Data  gathered  by:  CAPT  DAVID  MARTIN 
File  Tise  and  Date:  15:49:15  06-30-89 


Variables  Changed  by  Delta  =  .05 

Confidence  Level  of  Base  and  Depot  Spares  =  .95 


Ra,.k 

Variable 

Original  Value 

■  Upper 

Lower 

Sensitivity 

1 

PIUP 

20.00 

21.00 

19.00 

121.886300 

2 

MTBR 

1002.00 

1052.10 

951.90 

116.749700 

3 

AOH 

115644.00 

123426.20 

109861.80 

116.471500 

4 

NRTS 

.70 

.74 

.66 

107.010100 

5 

PSC 

3.00 

3.15 

2.85 

68. 165830 

6 

W 

160.60 

168.63 

152.57 

68.165720 

l 

DMC 

743. 00 

780.15 

705.85 

27.518570 

8 

SYSI 

846500.00 

888825.00 

804175.00 

19.403490 

9 

UC 

7800.00 

8190.00 

7410.00 

9.654753 

10 

DLR 

21.46 

22.53 

20.39 

9.537736 

11 

DMH 

12.00 

12.60 

11.40 

9.537736 

12 

BLR 

9.57 

10.05 

9.09 

5.785517 

13 

RMC 

230.50 

242.02 

218.98 

5.389195 

14 

COND 

.01 

.01 

.01 

5.363751 

15 

PP 

49.00 

51.45 

46.55 

5.177854 

16 

RMH 

8.40 

8.82 

7.98 

4.253294 

17 

M 

11.00 

11  55 

10.45 

3.959090 

13 

POH 

13467.00 

14140.35 

12793.65 

1.787917 

19 

DRCT 

1.80 

1.89 

1.71 

1.787917 

20 

MTBD 

4071.00 

4274.55 

3867.45 

3.787917 

21 

RTS 

.30 

.32 

.28 

1.378988 

2? 

BMH 

8.42 

8.84 

8.00 

1.279048 

23 

P.AMH 

,50 

.52 

.47 

.253174 

24 

?A 

1.00 

1.05 

.95 

.118507 

25 

BMC 

6.30 

6.62 

5.99 

.099940 

26 

SA 

2.55 

2.68 

2.42 

.025673 

27 

PCB 

.00 

.00 

.00 

. 000000 

28 

GST 

.70 

.74 

.55 

000000 

29 

DEVC 

.00 

.00 

.00 

.000000 

30 

BRCT 

4.00 

4.20 

3.80 

. 000000 

31 

SMI 

.00 

.00 

.00 

.000000 

32 

SMH 

.00 

.00 

.00 

. 000000 

33 

BOW 

.00 

.00 

.00 

. 000000 

31 

IMC 

.00 

.00 

.00 

. 000000 

35 

SEC 

.00 

.00 

.00 

. OoOOOO 

Appendix  I:  Initial  Inputs  r  or  T-14IA/5  'ISP  A1  Per  nan : 


/e 


cost  analysis  and  strategy  assessment  icasa)  model--version  i.o 


LIST  INPUTS  PROGRAM 


DEFENSE  SYSTEMS 
MANAGEMENT  COLLEGE 


INPUT  LCC  DATA  FILE:  cl41csd.dat 


Level  1  =  ORGANIZATIONAL 
Level  2  =  INTERMEDIATE 
Level  3  =  DEPOT 


NOTE:  Numbers  in  parentheses  following  section  headings 

denote  references  from  CASA  Users  Manual 


07-15-09 


STUDY  NAME  (4.1):  C-141  Constant  Soeed  Drive 

GENERAL  INPUT  INFORMATION  (4.2) 


Reliability  Growth  Option:  N  (None) 

Initial  Year  of  Study:  1985 

Yuar  in  Which  Dollars  are  Expressed;  1985 

Study  Life  (Months):  300 

Cost  Adjustment  Factor:  1.000 

MTBF  Adjustment  (Degradation)  Factor:  1.000 

Average  Operating  Hours  per  Month  per  System:  83.83 

System  Operator  Required  Portion;  .00000 

System  Operator  Labor  Rate  (I/hr):  .00 

Support  Equipment  and  Spares  Factor:  1.000 

Portion  of  Repair  Time  Spent  on  RT0K:  .000 

Consumables  Cost  as  Portion  of  Piece  Parts  Cost:  .000 


MAINTENANCE  LEVEL  INFORMATION  (4.3) 


Level  1 

Level  2 

Level  3 

No.  of 

Operating 

Sys terns  per  Loc . 

108  . 

0  . 

1084 

Ma  ;  n  t  e  n 

ance  Labor 

Rate  (l/hr)  . 

9.57 

.  00 

2  1.46 

Aval  lab 

le  Support 

Equip .  Hours  per  Mo .  . 

173. 

173, 

173. 

Support 

Equipment 

Utilization  Factor; 

1  .00 

1  .  00 

1  .  00 

Initial 

Spt  Eq  Sp 

ares  Co3t  Portion: 

.  95 

95 

.  95 

Spares 

Conf  idence 

Level  ; 

.95 

.  95 

.  95 

Earned 

Hour  Ratio 

1  .00 

1  .  00 

1  .  00 

System 

Repair  El  a 

pseJ  T i me  (Hours  ) 

ie  00 

.  00 

4  9  00 

SYSTEM  PRODUCTION  AND  COST  DATA  (4.4) 


Previous  Quantity  of  Systems  Produced:  2007. 
8a3e  Unit  Cost  per  System  (*)  :  80133.78 
Installation  Cost  par  System  (A):  .00 


Quantity  Quantity  Rata 

Year  Produced  Slope  Slope 

1985  0.  1.0000  1.0000 


SYSTEM  DEPLOYMENT  DATA  (4.5) 


Year 

Jan 

Feb  Mar  Apr 

May 

Jun  Jul 

Aug 

Sep  Oct  Nov  Dec 

1985 

1084  . 

O 

o 

o 

0. 

0.  0. 

0. 

0.  0.  0.  0 

SYSTEM  HARDWARE  DATA  (4.11) 

List  of  Abbreviations: 

COND  :  Portion  of  failures  expected  to  be  condemned 

DPT  :  Depot  level 

INT  Intermediate  level 

K  Adjustment  (Degradation)  factor  for  MTBF 

LREM  :  Primary  Removal  Level 

LRPR  :  Primary  Repair  Level 

MCPR  :  Material  cost  per  repair 

MTBF  :  Mean  time  between  failures 

MTTR  :  Mean  time  to  repair 

NRTS  .  Portion  of  failures  not  repairable  at  the  primary  repair  level 

0RG  :  Organizational  Level 

QPNHA:  Quantity  per  next  higher  assembly 

RTOK  :  Portion  of  failures  expec'ed  to  retest  okay 

TAT  :  Turnaround  time  in  months 


1) 

No. 

Item  Name 

Type 

Unit  Cost  QPNHA  MTBF 

K 

MTTR 

2) 

Weight 

- Spares  TAT  — 

NRTS 

COND 

(Lb. 

0RG 

INT 

DPT 

u  1’ 

.PR 

LREM  RTOK 

MCPR 

NRTS 

TAT 

COND 

TAT 

:  i 

1  C  o  n  t 

ant  Speed 

Drive 

1 

50133.76 

1  1595.  1 

.000 

16.00 

2: 

75 . 00 

.  03 

00 

1  .  05 

3 

1  .001 

2683.24 

.790 

>  05 

.  000 

.00 

i ; 

2 

2 

.00 

1 

1  .  1 

.  000 

.00 

2) 

.  00 

.  00 

.  00 

.  00 

2 

1  . 000 

.  00 

.  000 

.  00 

000 

.00 

1  > 

3 

3 

00 

1 

1  .  1 

.  000 

.00 

a.  ' 

.  00 

.00 

.00 

.00 

3 

2  .00. 

.  00 

.000 

.00 

.000 

.00 

MISCELLANEOUS  OPERATION  AND  SUPPORT  COSTS  (4.30) 


Name 

Annual  Gen.  Repairs 


Year 

Cos  t 

1985 

489000.00 

1986 

489000.00 

1987 

489000.00 

1988 

489000.00 

1989 

489000.00 

1990 

489000. 0" 

1991 

489000.00 

1992 

489000.00 

1993 

489000.00 

1994 

489000.00 

1995 

489000.00 

1996 

489000.00 

1997 

489000.00 

1998 

489000.00 

1999 

489000.00 

2000 

489000.00 

2001 

489000.00 

2002 

489000.00 

2003 

489000.00 

2004 

489000.00 

2005 

489000.00 

2006 

489000.00 

2007 

489000.00 

2008 

489000.00 

2009 

489000.00 

TRANSPORTATION  COST  DATA  (4.16) 


Cost  (•)  per  Pound  Between; 

Organizational  and  Intermediate  Levels;  .000 

Organizational  and  Depot  Levels;  3.000 

Intermediate  and  Depot  Levels;  .000 

Depot  Level  and  a  Factory  Depot:  .000 

Paperwork  and  Packaging  Cost  per  Trip:  .000 


Appendix 


.nil  I .a i  In: 


: - 1 4 1 A / B  VSCF  Alternative 


COST  ANALYSIS  AND  STRATEGY  ASSESSMENT  (CASA)  MODEL- - VERS ION  1.0 


LIST  INPUTS  PROGRAM 


DEFENSE  SYSTEMS 
MANAGEMENT  COLLEGE 


INPUT  LCC  DATA  FILE:  cl41vscf.dat 


Level  1  =  ORGANIZATIONAL 
Level  2  =  INTERMEDIATE 
Level  3  -  DEPOT 

NOTE:  Numbers  in  parentheses  following  section  headings 
denote  references  from  CASA  Users  Manual 


STUDY  NAME  (4.1):  C141  Variable  Speed  Constant  Frequency  Drive 


GENERAL  INPUT  INFORMATION  (4.2) 


Reliability  Growth  Option: 

B  (None) 

Initial  Year  of  Study: 

1985 

Year  in  Which  Dollars  are  Expressed: 

1985 

Study  Life  (Months)  : 

300 

Cost  Adjustment  Factor: 

1.000 

MTBF  Adjustment  (Degradation)  Factor: 

1.000 

Average  Operating  Hours  per  Month  per 

System: 

03.83 

System  Operator  Required  Portion: 

.00000 

System  Operator  Labor  Rate  (J/hr) : 

.00 

Support  Equipment  and  Spares  Factor: 

1.000 

Portion  of  Repair  Time  Spent  on  RTOK : 

.000 

Consumables  Cost  as  Portion  of  Piece 

Parts  Cost: 

.000 

MAINTENANCE  LEVEL  INFORMATION  (4.3) 

Level  1 

Level  2 

Level  3 

No.  of  Operating  Systems  per  Loc . ; 

108  . 

0. 

1084  . 

Maintenance  Labor  Rate  (S/hr): 

9.57 

.On 

2  1.46 

Available  Support  Equip.  Hours  per  Mo 

.:  173. 

173. 

173. 

Support  Equipment  Utilization  Factor: 

1  .00 

1.00 

1  .  00 

Initial  Spt  Eq  Spares  Cost  Portion. 

.95 

.95 

.95 

Spares  Confidence  Level: 

.95 

.95 

.95 

Earned  Hour  Ratio: 

1  .00 

1 .00 

1.00 

System  Repair  Elapsed  Time  (Hours): 

16  00 

.  00 

48  00 

SYSTEM  PRODUCTION  AMD  COST  DATA  (4.4) 

Previous  Quantity  of  Systems  Produced:  0. 
Base  Unit  Cost  par  System  (A);  75400.00 
Installation  Cost  par  Systam  (S) ;  15000.00 


Quantity  Quantity  Rata 
Year  Produced  Slop#  Slope 

1985  1435.  1.0000  1.0000 


SYSTEM  DEPLOYMENT  DATA  (4.5) 


Year 

Jan 

Feb  Mar  Apr 

May  Jun 

Jul  Aug 

Sep  Oct  Nov  Dec 

1985 

1084. 

o 

o 

o 

0.  0. 

0.  0. 

O 

o 

o 

o 

SYSTEM  HARDWARE  DATA  (4.11) 

List  of  Abbreviations; 

COND  ;  Portion  of  failures  expected  to  be  condemned 

DPT  :  Depot  level 

INT  Intermediate  level 

X  ;  Adjustment  (Degradation)  factor  for  MTBF 

LREM  ;  Primary  Removal  Level 

LRPR  ;  Primary  Repair  Level 

MCPR  :  Material  cost  per  repair 

MTBF  ;  Mean  time  between  failures 

MTTR  ;  Mean  time  to  repair 

NRTS  :  Portion  of  failures  not  repairable  at  the  primary  repair  level 

ORG  :  Organizational  Level 

QPNHA:  Quantity  per  next  higher  assembly 

RTOX  ;  Portion  of  failures  expected  to  retest  okay 

TAT  Turnaround  time  in  months 


1) 

No. 

Item  Name 

Typ 

9 

Unit  Cost  QPNHA 

MTBF 

X 

MTTR 

?) 

We l Xh  t 

—  Spares  TAT  — 

NRTS 

COND 

(Lbs) 

ORG  INT 

DPT 

LRPR 

LREM  RTOX  MCPR 

NRTS 

TAT 

COND 

TAT 

1) 

1 

Var 

Spd  Cnt  Freq 

Dr 

1 

74500.00  1 

4000.  1 

.000 

16.00 

2) 

75.00 

.03  .00 

1.05 

3 

1  .001  1969 

92 

.  790 

1  .  05 

.  000 

.  00 

1) 

2 

2 

.00  1 

1  .  1 

.000 

.00 

2) 

.00 

.00  .00 

.00 

2 

1  .000 

.00 

.000 

.00 

.000 

.  00 

1) 

3 

3 

.00  1 

1.  1. 

.000 

.00 

2) 

.00 

.00  .00 

.00 

3 

2  . 000 

00 

.000 

.00 

.000 

.  00 

PRE-PRODUCTION  NON-RECURRING  ENGINEERING  COSTS  (4.9) 


Name 

Year 

Cost 

Airframe  Non-Recurr 

1985 

1600000.00 

MISCELLANEOUS  ACQUISITION 

COSTS 

(4.29) 

Name 

Year 

Cost 

PRAM  Cst/Cont  Nonrec 

1985 

7000000.00 

TRANSPORTATION  COST  DATA  (4.16) 

Cost  (!)  por  Pound  Between; 

Organizational  and  Intermediate  Levels: 
Organizational  and  Depot  Levels; 
Intermediate  and  Depot  Levels: 

Depot  Level  and  a  Factory  Depot: 

Paperwork  and  Packaging  Cost  per  Trip: 


.  000 
3 . 000 
.000 
.000 

.000 


Appendix  K:  Initial — Inpu. 

Power  5api 


,s  for  AN / ALR-46 / 69  Existing, 
5 1  y  Alt  emit  ive 


COST  ANALYSIS  4MB  STRATEGY  ASSESSMENT  (CASA)  MODEL- -?ERSIO»  1.0 


LIST  INPUTS  ? BOG RAH 


DEFUSE  SYSTEMS 
MANAGEMENT  COLLEGE 


INPUT  LCC  DATA  FILE:  exist46.dat 


07  -  22  *  6P 


Leve 1  1  »  ORGANIZATIONAL 
Level  2  «  INTERMEDIATE 
Level  3  *  DEPOT 

NOTE:  Numbers  in  parentheses  following  faction  headings 

danota  ralarancia  from  CASA  Ufarf  Manual 


STUDY  NAME  (4.1):  Existing  AN/ALB-46/69  Power  Supply 


GENERAL  INPUT  INFORMATION  (4.2) 

Reliability  Growth  Option: 

Initial  Tear  of  Study: 

Tear  in  Which  Dollar#  are  Expressed; 

Study  Lila  (Months): 

Cost  Adjustment  Factor; 

IfTBF  Adjustment  (Degradation)  Factor: 

Average  Operating  Hours  per  Month  per  System: 
System  Operator  Required  Portion: 

System  Operator  Labor  Rate  (S/hr) : 

Support  Equipment  and  Sparse  Factor: 

Portion  of  Repair  Time  Srent  on  RTOX : 
Consumables  Cost  as  Portion  of  Piece  Parts  Cost: 


N  (None) 
1985 
1985 
120 
1.000 
1 . 000 
26.34 
. 00000 
.  00 
1  000 
.  000 
.010 


MAINTENANCE  LEVEL  INFORMATION  (4.3) 


No.  of  Operating  Systems  per  Loc .  ; 
Maintenance  Labor  Rate  (S/hr): 
Available  Support  Equip.  Hours  per  Mo.. 
Support  Equipment  Utilization  Factor: 
Initial  Spt  Eq  Spares  Cost  Portion: 
Spares  Confidence  Level: 

Earned  Hour  Ratio. 

System  Repair  Elapsed  Time  (Hours): 


Level  1 


Level  2 


Level  3 


25. 

0  . 

3319 

9.57 

.  00 

46.32 

173. 

173. 

173. 

1 .00 

1  .  00 

1 . 00 

.  95 

.  10 

.95 

.  95 

.  95 

95 

1 . 00 

1  00 

1  00 

6  65 

72 . 00 

11.18 

SYSTEM  PRODUCTION  AND  COST  DATA  (4.4) 

Previous  Quantity  of  Systems  Produced.  3765. 
Base  Unit  Cost  per  System  (S).  4160.00 
Installation  Cost  per  System  (#):  .00 


PRE-PRODUCTION  MOM-  RECURRING  ENG  I  NEER1  NO  COSTS  (4  9) 

Name  Tear  Coat 

PRAM  PROJECT  COST  0  600000.00 

SYSTEM  HARDWARE  DATA  (4.11) 

Liat  of  Abbrev i at i on*  : 

COND  Portion  of  failurea  expected  to  be  condemned 

DPT  Depot  level 

1NT  Intermediate  level 

K  Adjuatment  (Degradation)  factor  for  IfTBF 

LREM  :  Primary  Removal  Laval 

LRPR  :  Primary  Repair  Laval 

MCPR  :  Material  coat  par  repair 

MTBF  :  Mean  time  between  failurea 

MTTR  :  Mean  time  to  repair 

NRTS  Fvruori  of  failurea  not  repairable  at  the  primary  repair  level 

ORG  Organizational  Level 

QPNHA:  Quantity  per  next  higher  assembly 

RTOK  Portion  of  failurea  expected  to  reteat  okay 

TAT  Turnaround  time  in  montha 


1 1 

No  . 

Item  Name 

Type  Unit  Coat  QPNHA 

MTBF 

K 

MTTR 

2) 

Weight 

- Sparea  TAT  — 

NRTS 

COND 

(Lba) 

ORG 

I NT  DPT  LRPR  LREM  RTOK 

MCPR  NRTS 

TAT 

COND 

TAT 

1  ) 

1 

ALR-46/ 

69  : 

Power  Sup 

1 

3000.00  1 

10000 

1 

.  000 

1  .  50 

2) 

5 . 00 

.  10 

.  00 

91 

3 

1  . 000 

78.00 

895 

.90 

.  000 

.  00 

1  ) 

2 

2 

.  00  1 

1 

1 

.000 

.00 

2) 

.  00 

.00 

.  00 

.00 

2 

1  .  000 

.  oo 

000 

.00 

.  000 

.  00 

1  ) 

3 

3 

.  00  1 

1 

1 

.  000 

.00 

2) 

.  00 

.00 

.  00 

.  00 

3 

2  . 000 

.  00 

000 

.  00 

.  000 

.  00 

SYSTEM 

DEPLOYMENT 

DATA  (4.5) 

Year 

J  an 

Feb 

Mar  Apr 

May 

Jun 

Jul 

Aug 

Sep 

Oc  t 

Nov 

Dec 

1985 

3319  . 

0  . 

0.  0. 

0  . 

0  . 

0 

0. 

0  . 

0  . 

0  . 

0 

TRANSPORTATION  COST  DATA  (4.16) 


Cost  (•)  per  Pound  Between; 

Organizational  and  Intermediate  Levels  000 

Organizational  and  Depot  Levela:  4  080 

Intermediate  and  Depot  Level*:  ,000 

Depot  Level  and  a  Factory  Depot;  ,000 

Paperwork  and  Packaging  Coat  per  Trip;  000 
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Appendix 


Initial  Inputs  for  AN/ALR-46/59  Improved 
Power  Supply  Alternative 

COST  AJULTSIS  ADD  STRATEGY  ASSESSMENT  (CASA)  MODEL- - VERS  ION  1.0 

iiiiuiiiiiimiuiidiimiiiiiiiiiiMiiiiiMiumiiimiiiin 

LIST  IIPOTS  PROGRAM 


DEFENSE  SYSTE1C 
management  COLLEGE 


INPUT  LCC  DATA  FILE:  new48.d* t  07-24 


Laval  1  »  ORGANIZATIONAL 
Laval  2  *  INTERMEDIATE 
Laval  3  *  DEPOT 

NOTE:  Number*  in  parenthe***  following  faction  headings 

denita  nfarancai  from  CASA  U*er*  Manual 


STUDY  NAME  (4.1).  Improvad  AN/ ALR - 4 6/ 89  Power  Supply 
GENERAL  INPUT  INFORMATION  (4.2) 


Reliability  Growth  Option:  N  (Nona) 

Initial  Yaar  of  Study:  1983 

Yaar  in  Which  Dollar*  ara  Expressed:  1985 

Study  Lifa  (Month*):  120 

Cost  Adju*tmant  Factor:  1.000 

WTBF  Adju*tmant  (Degradation)  Factor:  1.000 

Average  Operating  Hour*  par  Month  par  System:  28.34 

System  Operator  Required  Portion:  .00000 

System  Oparator  Labor  Rata  (•/ hr):  .00 

Support  Equipment  and  Spare*  Factor:  1.000 

Portion  of  Repair  Tima  Spent  on  RTOX.  .000 

Consumable*  Coat  a*  Portion  of  Piaca  Part*  Co*t:  .010 


MAINTENANCE  LEVEL  INFORMATION  (4.3) 


Level  1 

Level  2 

Level 

No.  of  Operating  Syatam*  par  Loc .  : 

25. 

0  . 

3319 

Maintenance  Labor  Rata  (M/hr): 

9.  57 

35 . 00 

48  32 

Available  Support  Equip.  Hour*  per  Mo  ; 

173. 

173  . 

173 

Support  Equipment  Utilization  Factor. 

1  .  00 

1 . 00 

1  00 

Initial  Spt  Eq  Spare*  Co*t  Portion: 

.  95 

.  10 

95 

Spare*  Confidence  Level: 

.  95 

.  95 

95 

Earned  Hour  Ratio 

1  .  00 

1  .  00 

1  .  00 

System  Repair  Elapsed  Time  (Hour*): 

8 . 85 

72 . 00 

1  30 

SYSTEM  PRODUCTION  AND 

COST  DATA 

(4.4) 

Previou*  Quantity 

of  System* 

Produced : 

3785 

Base  Unit  Cost  per 

System  ( • ) 

3000  00 

Installation  Co* ' 

per  System 

(«)  . 

.  00 

SYSTEM  DEPLOYMENT  DATA  (4.5) 


Year  Jan  Feb  Mar  Apr  May  Jun  Jul  Aug  Sap  Oct  Nov  D«c 
1985  3319.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0 


SYSTEM  HARDWARE  DATA  (4.11) 

List  of  Abbreviations  : 

COND  :  Portion  of  failures  expected  to  be  condemned 
DPT  Depot  level 

I  XT  Intermediate  level 

X  Adjustment  (Degradation)  factor  for  MTBF 

LREM  :  Primary  Removal  Level 

LRPR  :  Primary  Repair  Level 

MCPR  :  Jiatenal  cost  per  repair 

MTBF  Mean  time  between  failures 

KTTR  Mean  time  to  repair 

NRTS  Portion  of  failure*  not  repairable  at  the  primary  repair  level 

ORG  Organizational  Level 

QPNHA:  Quantity  per  next  higher  assembly 

RTOK  :  Portion  of  failures  expected  to  retest  okay 

TAT  Turnaround  time  in  months 


1 ) 

No  . 

Item  Name 

Type 

Unit  Cost  QPNHA 

MTBF 

K 

MTTR 

CONI 

TAT 

2) 

Weight 

(Lbs) 

---Spares  TA 
ORG  INT 

7  -  -  - 
DPT 

LRPR 

LREM  RT0X 

MCPR 

MRTS 

NRTS 

TAT 

COND 

1  > 

1 

ALR-4C/89  Power  Sup 

1 

4160.00 

1 

2960.  1 

.  000 

11.18 

2) 

5 . 00 

.  10 

.  00 

.91 

3 

1  . 000 

78 . 00 

895 

.  90 

000 

.  00 

1  ) 

2 

2 

.  00 

1 

1  .  1 

.  000 

00 

2) 

.  00 

.  00 

.00 

.  00 

2 

1  .  000 

.  00 

.  000 

.  00 

.  000 

.  00 

1  ) 

3 

3 

.  00 

1 

1  .  1 

.  000 

00 

2) 

.  00 

.  00 

.  00 

.  00 

3 

2  000 

.  00 

.  000 

.  00 

.  000 

00 

TRANSPORTATION  COST  DATA  (4.19' 


Cost  (S)  per  Pound  Between; 

Organizational  and  Intermediate  Level*.  .000 

Organ  zational  and  Depot  Levels  4.080 

Intermediate  and  Depot  Levels;  000 

Depot  Level  and  a  Factory  Depot;  .000 

Paperwork  and  Packaging  Cost  per  Trip;  000 
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The  evolution  of  the  USAF  PRAM  Program  Office  is  discussed, 
and  the  process  that  PRAM  uses  to  assess  technology  is 
addressed.  Finally,  the  evolution  of  computer-based  logis¬ 
tics  support  models  is  reviewed,  focusing  on  the  capabili¬ 
ties  that  current  models  offer  the  supportability  analyst. 

Three, PRAM  projects  were- selected  for  analysis.  The 
projects  represented  "typical"  PRAM  projects.  A  structured 
approach  was  taken  to  determine  the  decision  orientation 
and  data  available  for  each  project. 

A  model  survey  was  made  to  identify  models  that  might 
have  capabilities  matching  the  level  of  analysis  required 
for  each  project.  The  informal  survey  identified  the  need 
for  a  greater  amount  of  data  for  model  use.  During  this 
additional  data  gathering  process,  data  quality  issues 
surfaced,  indicating  the  need  for  models  with  strong  sen¬ 
sitivity  analysis  capabilities.  After  all  additional  data 
was  collected,  final  model  selection  was  made,  and  analyses 
were  performed  using  two  models,  the  Statistically  Improved 
Life  Cycle  Cost  (SILCC)  and  Cost  Analysis  and  Strategy 
Assessment  (CASA)  models. 

This  research  demonstrated  that  more  thorough  eco¬ 
nomic  analysis  was  possible  using  logistics  models.  In 
two  of  the  projects  analyzed,  the  findings  revealed 
the  original  PRAM  analysis  had  overestimated  the  cost 
savings  of  the  proposed  improvement.  Additionally', 
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